Heroku can't keep up with current market volume
badgerwithagun opened this issue · 5 comments
Significant lag occurring when BTC/USD pairs are subscribed, causing memory issues on the box and delayed data.
Two problems here:
- The basic Heroku box is too slow
- We are backing up messages rather than dropping them where we can afford to do so
Need to investigate
Not yet, but I doubt I'll bother. This thing is working constantly all day. It needs 24 hours of compute per day. Looks like 55.43 GBP/Month on Azure, and I'd have to set up the pipeline myself. Nope!
If I'm going to go to the effort of setting up a CD pipeline to a cloud provider, it'll probably be AWS.
Promising performance from a $10/month Vultr server. I'm still working on the deployment scripting. I plan to open source that too.
Full replacement of Heroku includes the full CD pipeline, infrastructure-as-code and provisioning. I have this all mostly working now but am working through getting it bomb-proof.