From the blog post, the largest individual Ray cluster that was observed running a production compaction job in Q1 had 26,846 vCPUs and ~210TiB of RAM. This is roughly equivalent to a Ray cluster composed of 839 r5.8xlarge EC2 nodes (w/ 32 vCPUs and 256GiB RAM per node).
For those interested, this would be at a cost of:
- ~$1691/hour on demand
- ~$1065/hour reserved
- ~$521/hour spot
Not including any related data transfer costs.
Wow that is not NEARLY as expensive as I would have imagined considering the scale of the data involved.
That's also $41k / 26k / 13k per day or $1.2M / 767k / 375k per month!
I mean, for all of Amazon's business intelligence, running on servers operated by Amazon... tis a mere pittance.