So, is the market really absurd?
Just because some billionaires are desperate for growth to grow their hundred billions into trillions outbidding each other does not mean that 90% of humanity cannot make use of ML running locally on cheaper GPUs.
Also, housing is a basic human right, whereas fast GPUs probably are not.
Infact you can argue that something is really wrong in our governance if housing is human right and yet there are people profiteering from how unaffordable it has become.
I am more appalled at how long it has taken for the big tech other than Google to standardized ML workload and not be bound by CUDA.
There is, however, a political barrier to increasing the housing supply.
That's how this scheme works. The card is most likely not profitable at consumer price points. Without this segmentation, consumer cards would trail many years behind the performance of datacenter cards.
But clearly, lack of competition is one thing that supports whatever rent Nvidia seeks.