https://www.microcenter.com/product/709071/pny-nvidia-rtx-pr...
Also, while memory bandwidth is important, it isn’t the only consideration. Apple’s architecture has memory bandwidth equal to a mid-range consumer GPU, but its GPU speed is much, much worse than, say, a 5080 or 5090. This translates into e.g. much slower time to first token on Mac systems compared to dedicated GPUs.
I’m wrong about the prices, but $4k-$5k for a GPU is way out of hobbyist range where a computer that I can use for other stuff is accessible.
Or you can spend ~$2k on a pair of 3090s, which gives you 48GB of memory and will also be significantly faster than the M1 Ultra.
IMO there is no situation in 2026 where buying a 32GB M1 Ultra is the right move.
edit: for the folks brave enough to try them there are also additional aftermarket/modded options; I've seen both 4080 Super cards upgraded to 32GB of memory, and 4090 cards upgraded to 48GB. The former comes in at $2k-2.5k and would still be faster than the M1 Ultra.
I know you probably weren't referring to this type of memory in your post, but IMO it might be worth avoiding this term in the future unless you're referring to HBM, the standard.