Hacker News Reader

I wouldn’t stop at 16GB right now.

24 is the lowest I would go. Buy a used 3090. Picked one up for $700 a few months back, but I think they were on the rise then.

The 3000 series can’t do FP8fast, but meh. It’s the OOM that’s tough, not the speed so much.

Are there any 24GB cards/3090s which fit in ~300mm without an angle grinder?

if you're going to get that kind of hardware, you need a larger case. IMHO this is not an unreasonable thing if you are doing heavy computing

Noted for my next build - I am aware this is a problem I've made for myself, otherwise I like the mini-ITX form factor a lot

Which do you like more OOM for local AI, or an itty bit case?

5070 Ti Super will also have 24GB.

Oh nice, thank you :)

Admittedly a little tempting to see how the 5070 Ti Super shakes out!

I'm waiting too :)

50xx series supports MXFP4 format, but I'm not sure about 3090.