Hacker News Reader

Comment by MrBuddyCasino | Hacker News Reader

I suppose this is one of the reasons (besides AMD dropping the ball) they aren't even trying to be competitive in the gaming market - they can sell the same mm2 silicon area for much more to AI startups:

"There's a full blown run on GPU compute on a level I think people do not fully comprehend right now. Holy cow.

I've talked to a lot of vendors in the last 7 days. It's crazy out there y'all. NVIDIA allegedly has sold out its whole supply through the year. So at this point, everyone is just maximizing their LTVs and NVIDIA is choosing who gets what as it fulfills the order queue." [0]

[0] https://twitter.com/Suhail/status/1683642991490269185

View on HN

Suhail lacks wisdom.

Stop obsessing about cloud GPUs.

Go buy retail GPUs.

Make them work. Adapt your software. Whatever, stop whining about cloud GPUs just switch to retail.

Solve the barriers/limitations. This has been the essences of computing for 60 years. Stop being intimidated by Nvidia. Get your job done in what is available.

Buy AMD, buy Intel. Work out how to make your GPU thing work on them. Stop wringing your hands about how there’s no cloud GPUs when there’s a ton of cheap retail GPUs.

INNOVATE. Look beyond nvidia. Stop whining.

If you’ve bet your entire business on cloud GPUs then you’re a fool. Bet on retail GPUs.

> Solve the barriers/limitations

I don't think this is possible when you can't pool memory on the 40 series retail GPUs.

>Stop wringing your hands about how there’s no cloud GPUs when there’s a ton of cheap retail GPUs.

See your R&D investment goes up in flames after driver update to block such workload.

There's something to this.

But also... don't update drivers and accept you are missing out on updates that might also be useful.

Ok, so make an enormous capital investment in tech that will be outdated in two years - if not already outdated, as you mentioned AMD and Intel. Then, I'll need to hire geniuses who can extract juice out of this hardware at a scale that not even Google, Amazon, Microsoft and others could.

Or, I rent just as much top performance hardware as I need, scaling as I go along, and worry about execution and implementation of my niche application instead. You can see why cloud is winning right now.

Except as the previous post points out, you can’t get cloud GPUs.

No it doesn't, and yes you can.

You can't buy GPUs to build your own cloud. You can access cloud GPUs via the ones that NVidia is selling to.

>Stop obsessing about cloud GPUs.

>Go buy retail GPUs.

If you're doing this professionally, you know what you need and what your budget is.

If you're doing this personally, to simply learn? I did the math for myself and figured I could probably buy enough gpu credits for the cost of a 4090 build that it would probably serve me all the way through getting a phd.

Reply on news.ycombinator.com