35 karma · joined May 30, 2013
Intercom uses another company for their data too: https://docs.intercom.io/help-and-faqs/your-users-data-in-in...
One thing is odd though, there is no mention of disk space at all and only a configuration of retention time. One of Kafka's best features is the use of disk to store large amounts of messages, you are not RAM bound. Heroku seems to only allows you to set retention times? This could be awesome if they are giving you "unlimited" disk space, but could also be a beta oversight. Interested to see how this progresses.
Any ideas?
So handy to just shoot a text instead of opening an app and navigating to the right list.
I love how they work in the public and really advocate open source. One cool project is their analytics reporter: https://github.com/18F/analytics-reporter
Java on the other hand takes time to warm up. It just isn't practical to redeploy the whole app when you are just updated one aspect.
But for data stability, I see why it was done. It is a trade off, one that we may reconsider down the line.
Edit: Misread the question. I'm not exactly sure, but it significantly improves speed, enough for us to complete the migration, then switch it back on during production.
One note: when running on a VM, it seems not to flush to disk regardless of the OS setting. Probably because of the virtualization software
Full disclosure: I wrote the tool during a work hackathon. It has come a long way since then.
Cheers.