You are assuming they are paying retail price, which they certainly are not.
Some people will pay more to be first in line.
Given that GPU production is mostly sold out, and that giving META a bigger discount would simply mean losing money from other purchasers.
Presumably all the chip supply issues regarding autos have been resolved, and yet prices have risen 30% in a decade, and there’s no reversal.
What are they going to do? Buy AMD, yeah right.
Nvidia's sales are only limited by the number of wafers they can get from TSMC.
Build their own? It's what Microsoft, Google, and AWS are doing.
>Nvidia's sales are only limited by the number of wafers they can get from TSMC.
No, they're limited by the cost per operation vs. Facebook building their own. The cloud providers have already decided it's cheaper to do it themselves. Sure they'll keep buying GPUs for general public consumption but that may eventually end too.
There is no value into the NVIDIA-part by itself, only the raw power is interesting.
If tomorrow this is AMD, or China-Town chip, it's perfectly fine.
I wouldn't miss the CUDA toolkit mess.
We are not, because there's clearly value in the CUDA ecosystem.
Sane business people will look to decentralize their compute over time and not be reliant on a single provider. AMD will be able to take advantage of that and they've already stated that is their focus going forward.
ROCm/HIP are getting incrementally better, MI300x have 192GB and benchmarks are looking good, the only problem is that nobody has access to the higher end hardware from AMD today. That's why I'll have MI300x, for rent, soon.