- 6.3 million feed updates per day per server
- 111 API requests per minute per server
If you guess 4 cores per server it even sounds worse.
(Ps, will HN ever support better formatting?)
Since we can only speak in broad terms, those requests/updates aren't going to be evenly distributed throughout the day and they might not be consistent from day to day so some over-provisioning is reasonable.
Since they're on EC2 a) they shouldn't be that over-provisioned though and b) are getting comparatively (to bare metal) awful performance (say 2x-8x depending on exactly what they're doing) and paying for the privilege.
I'd like to better understand why "Fanout-on-write" wasn't their go-to solution. All they said was that it was "expensive".
- High Availability requires 2x or 3x more servers
- We run our own monitoring, log collection and tracing infrastructure
- ML/Analytics features
- Distribution of traffic
- Disaster Recovery
Edit: fix list formatting