Hacker News Reader

It's specified in the plain text:

--

Supported hardware:

NVIDIA SM100 GPUs

Huawei Ascend 950 NPUs

that doesnt say what cards the reference number used.

Are you looking for serial numbers or something? GPU family is enough to get the cost estimate.

SM100 -> Blackwell

It's harder than ever to get h100s and then you have to usually commit to a long time period upfront, but yeah this release should close some of the gap.

I also assume they will just slot in whatever cards they can get their hands on, so this figure could be an average.

I would love to read the details about how datacenters do load managing across such diverse hardware, if in fact they really are plugging in any computer hardware they can get on the market. Like how do they balance and serve an even customer experience across a wide range of hardware... is it by clustering similar hardware together?