Sure, those things too. I was meaning “inference” as a shorthand for any ai workloads.
Whatever analogy you want to use: gas, data transfer, it doesn’t matter. My point is that all the capacity is being hoarded for future use making it feel like a scarce resource now.
If the demand grows like they say it will, then hoarding was a smart choice and the people who own the GPUs will make lots of money. If the demand doesn’t grow as fast and as much as they say, then hoarding was a bad call and the house of cards collapses and a lot of people will lose a lot of money.
To use your data transfer analog - during the dotcom bubble a ton of fiber was built. But after the bubble popped most of it went unused for years. Some of that “dark fiber” is still unused today, 25+ years later. Afaik it would have been a lot cheaper and more stable for the economy to lay that fiber more incrementally.