In a competitive market that line has distortions where one player trts to undercut the other.
There are no bargains because there is almost no competitive pressure and so there is barely any distortion in that line.
"There's a full blown run on GPU compute on a level I think people do not fully comprehend right now. Holy cow.
I've talked to a lot of vendors in the last 7 days. It's crazy out there y'all. NVIDIA allegedly has sold out its whole supply through the year. So at this point, everyone is just maximizing their LTVs and NVIDIA is choosing who gets what as it fulfills the order queue." [0]
Stop obsessing about cloud GPUs.
Go buy retail GPUs.
Make them work. Adapt your software. Whatever, stop whining about cloud GPUs just switch to retail.
Solve the barriers/limitations. This has been the essences of computing for 60 years. Stop being intimidated by Nvidia. Get your job done in what is available.
Buy AMD, buy Intel. Work out how to make your GPU thing work on them. Stop wringing your hands about how there’s no cloud GPUs when there’s a ton of cheap retail GPUs.
INNOVATE. Look beyond nvidia. Stop whining.
If you’ve bet your entire business on cloud GPUs then you’re a fool. Bet on retail GPUs.
I don't think this is possible when you can't pool memory on the 40 series retail GPUs.
See your R&D investment goes up in flames after driver update to block such workload.
But also... don't update drivers and accept you are missing out on updates that might also be useful.
Or, I rent just as much top performance hardware as I need, scaling as I go along, and worry about execution and implementation of my niche application instead. You can see why cloud is winning right now.
>Go buy retail GPUs.
If you're doing this professionally, you know what you need and what your budget is.
If you're doing this personally, to simply learn? I did the math for myself and figured I could probably buy enough gpu credits for the cost of a 4090 build that it would probably serve me all the way through getting a phd.