Hacker News Reader

well an m5ad.24xlarge is 96 threads and 384G with your own 2xSSD (saves on EBS bandwidth costs). So fewer threads but a bit more memory. (we'll guess that is a 48 core EPYC 7642 equivalent with 96 threads since there is no 96 core version)

That bad boy costs $0.96/hr on the current spot prices (https://aws.amazon.com/ec2/spot/pricing/)

View on HN

That instance type is missing the RTX 2080 Ti-equivalent GPU, though...

The closest in performance to that GPU would be the V100 found in P3-instances.

Yea which are $3 / hour. Or, you could, shameless plug, use Lambda's GPU cloud which has V100s for $1.5 / hour!

https://lambdalabs.com/service/gpu-cloud

I'm embarrassed that I feel so compelled to post this--on a Friday night at that--I apologize.

> I'm embarrassed that I feel so compelled to post this--on a Friday night at that--I apologize.

Don't be. Finding gems like this is why some of us read the comments.

Frowning on self-promotion got us in those silos.

How does having your own SSD save on bandwidth? You have to send the data to and from the cores where the computation is taking place.

There are certainly some workloads where it makes sense to own your own storage and rent computation, but you can't assume that by default for a "powerful AI" workload.

It saves on bandwidth $ costs to EBS (AWS block storage)

Reply on news.ycombinator.com