Hacker News Reader

Hacker News

Comment by bix6 | Hacker News Reader

Full thread

bix6

So there’s a chance I can pickup some discounted GPUs next year?

View on HN

Zero chance. Secondary market for enterprise grade GPUs is white hot.

Next year is a long way away.

Less than two months?

There are weeks when decades happen.

Enterprise procurement cycles are not.

No, the other neoclouds will scoop up the remains. The H100 was released 4 years ago and its still near impossible to find at any discounted price.

Hyperscalers and SPVs are still planning on accelerating the buildout in 2027. Also even if everything hit the fan tomorrow, it will take time for production to shift back into consumer products if that's even what companies decide to shift to.

I don't the envisioned scenario is that a data centre company fails and Nvidia starts making RTX 5090s for consumers. Rather, one of these companies fails, their stock of enterprise GPUs gets flooded on the market, and suddenly the people/companies buying RTX 5090s for local inference can buy full fat enterprise GPUs, shifting demand.

If a neocloud fails, it makes more sense to recapitalize it and leave the GPUs in place. If you sell the GPUs nobody will have enough power to run them.

If you sell the GPUs, they will get dispersed all over the world.

Wow wow wow hold on now, RAM and GPUs are only for the AI lords

If by enterprise you mean datacenter (which is what CoreWeave is), the "full fat" cards aren't as plug-and-play in a desktop PC as the consumer cards. They don't typically come with fans, and are meant to be cooled using some kind of holistic whole-rack (or larger) setup. Hobbyists do sometimes buy datacenter GPUs secondhand (and I have considered it, for the price/performance ratio) but it's kind of a lot of work and they tend to run hot.

> [...] but it's kind of a lot of work and they tend to run hot.

Anyone that can open their computer to install an SSD, or a consumer-grade GPU, can install a data center GPU with a fan-kit; it's not rocket science.

There's probably still plenty of demand for that. At least someone in the executive team was floating around the idea of buying up some Nvidia cards to run AI models for the entire company somewhere locally. I don't think they'd be opposed to buying up data centre GPUs without fans if they suddenly flooded onto the market, even if that meant getting a rack chassis and a bunch of noisy server fans.

I've also seen someone sell their old fanless Nvidia cards on the local marketplace. There are definitely consumers running these things in their basements.

> but it's kind of a lot of work and they tend to run hot.

Most of the common used datacenter cards have people just 3d printing blower fan shroud attachments. Or using 3M/Gorilla Tape.

GPUs allow you to buy becoming more powerful. They are going to continue to be sought after.

Nop. The hyperscalers will gobble everything available, including any neo cloud that faces financial troubles

If you can out-bid the Chinese.

Reply on news.ycombinator.com