Hacker News Reader

Also, once they have decent consumer ML support, they could release a card that has a merely OK-ish GPU, but double the memory of nvidia counterparts (e.g. 32 or 48 GiB, or find some way to allow you to plug in your own memory), and it'd be crazy popular as well I think, because memory is the real limitation to what you can do, for inference at least!

View on HN

That's true although they will be concerned with product segmentation as well. Pro GPUs are where the margins are so they will be careful not to let their consumer gear cannibalise them too much. Nvidia seemingly does this by intentionally limiting VRAM on consumer parts where software support is more or less equivalent for CUDA so you'd imagine AMD could end up following the same path.

Yeah this is why competition is good. It's possible that AMD might just decide "fuck segmentation let's undercut Nvidia and steal marketshare" like they did with the first and second gen Threadripper / Threadripper PRO (later generations priced the Threadripper PRO's at "fuck you, just buy Epyc" prices while gatekeeping some key features from the non PROs).

What makes you think user upgradeable memory is feasible? Aren't the signaling requirements of GPU memory vastly more stringent than CPU memory?

Reply on news.ycombinator.com