Fascinating. Why was a message bus necessary and what message bus and database (presumably open source) solutions did you use?
Thanks for sharing the use case. Super clever solution.
Thanks for sharing the use case. Super clever solution.
The roll out was done in phases to ensure that the overhead would not be prohibitive as well as to make sure that it wouldn't cause egregious priority inversions.
Scribe [0] + LogDevice [1] + Scuba [2]. I believe Scribe was open sourced a very long time ago, and LogDevice more recently, but they are both archived now.
- [0]: https://engineering.fb.com/2019/10/07/data-infrastructure/sc...
- [1]: https://logdevice.io/
- [2]: https://research.facebook.com/publications/scuba-diving-into...
Any idea why those projects (Scribe and LogDevice) were mothballed? Did Facebook simply lose interest in maintaining or did other OSS projects enter the mix that proved to be a better fit? Thanks again for sharing.