Hacker News Reader

I would also love to see a consumer GPU with a lot of VRAM. I think 128 GB would be too expensive BUT I'm hoping the Nvidia 50 series comes with 32+ GB VRAM for at least the top tier cards of the family (today they max out at 24 GB VRAM in the 3090 and 4090.)

View on HN

imagine how impossibly sold out those cards would be.

4090s are only sold out because of the China sanctions and are moving back towards MSRP. Fundamentally even a 48GB desktop card would be no substitute for a B100.

yeah but if you had 4090s with H100 equiv VRAM (prob don't even need HBM equiv) that wouldn't require quantizing larger models you would end up with a ton of LLM workstations at a fraction of what they charge for H100s. The demand would be high. What China was doing with the 4090s requires a great deal of technical/manufacturing prowess that doesn't apply to most.

Reply on news.ycombinator.com