This whole saga has been a ridiculous waste of everybody's time and energy. There's no compelling argument that points to these new innovations not otherwise happening if RAM prices weren't artificially inflated by the fever dream of private equity.
The demand for high-ram consumption applications is higher than ever and rising. That demand is not created by nvidia, but nvidia's customers. nvidia's customers are buying nvidia parts built with other's ram because they have customers renting the compute.
Whoever nvidia is buying ram from will simply sell to the next highest bidder, and the ram will still be sold out through the coming years.
Contrary to the AI-bubble-doomsayers - most hyperscalers and neoclouds seem to be at capacity for current demand and even have already booked future demand.
If the good Lord's willing and the creek don't rise.
https://finance.yahoo.com/technology/articles/ram-crisis-one...
"The lawsuit also points towards similar collusion between the companies in the past. In 2005, SK Hynix and Samsung were fined $180 million and $300 million respectively after pleading guilty to price-fixing DRAM pricing. It is suggested that the same occurred between 2016 and 2018 when prices spiked again, ..."
RAM prices are a result of skyrocketing demand. That's hardly a fever dream.
You can hardly blame RAM suppliers for taking the money of people who are coming to them begging to pay more than the person before them in line. It's not like they are squeezing the market in some cartel price-fixing racket.It's the customers who are willing trying to pay more for better access. The innovations and the price of RAM are so non-sequitur at this point; I can't understand what point you're making. Sure, if RAM were as easy to get as the circuit boards they're being put on, innovation would be the same (or accelerated!) but that doesn't have anything to do with the fact that RAM is incredibly supply constrained and ramping production to meet the demand of a seemingly insatiable market takes a long time for a product this complicated and specialized.
If any of the manufacturing companies could have seen this coming, they'd have started ramping production to insane levels 5 years ago, and they'd be taking in just as much money as Nvidia is.
You don’t know this with certainty, do you?
Companies (CRWV, etc) are borrowing at 10%+ interest rates to buy NVidia GPUs that NVidia makes 75% gross margin on. I repeat, companies are selling junk bonds to buy GPUs at a 300% markup. Cocaine dealers probably don’t even make 75% gross margins.
Other companies (OpenAI, etc) are also borrowing at 10%+ interest to rent the GPUs to train LLMs.
All of these GPUs need a ton of RAM. There is a fixed supply of RAM. There is insane demand for RAM.
Besides, when demand outstrips supply you don't have to fix prices. Why would you? They cannot deliver all of the RAM people want. Think about it for a minute: how would price fixing even work?
(and don't get me started on the ridiculous "they're switching from DDR3 to HBM" part of that wikipedia article...)
My point is that we don’t know for sure. DRAM manufacturers have admitted to price fixing previously, and it’s the exact same companies that produce RAM today.
If you search for “price fixing cases in hardware”, you will find plenty of guilty pleads from other/unrelated HW companies that are more recent. Price fixing happens and sometimes they even get caught doing it ;)
> Think about it for a minute: how would price fixing even work?
In the past, it worked by manufacturers collectively agreeing on price quotes and margins IIUC.
I’m not claiming any foul play. I’m saying we can’t know for sure and it’s happened before.
Harming Nvidia would only make us more compute constrained, and raise prices further.
It seems it's impossible to get a certain type of person to understand this regardless of whether it's housing, education or chips.
Harming the producers of [thing] or disincentivizing profits will not make [thing] cheaper if demand remains the same (or if it is growing, like in all of the areas I mentioned).
What type of person are you referring to?