I worry they get so much money from hyperscalers we just get scraps. Consider that I'm running 6 and 8 year old GPUs for my local inference. If I wanted to replace my hardware with latest stuff (nvidia dgx, gorgon halo, Intel b70 or amd r9700 pro) it would cost me 4x the price and I'd cut the memory bandwidth in every single case. In case of dgx/strix were talking less that a quarter of memory bandwidth and a third of compute of a single rtx3090...

Those products are a sick joke played on us. About the only thing they have that is better than tjose ancient gpus is energy efficiency.

And what good are the weights when all the rtx3090s fail (they were pretty crappy to begin with) and every ddr3 Xeon system fails too?

I'm fully prepared to be running on my hardware that is 6 and 8 years old for next decade. Last 3 months saw rtx3090 going up by 20% each month.