Qwen 3.8 27B, not even the superior Flash Next 125B, running on a single 3090 in my workstation handily whoops ChatGPT 3.5 from just a couple years ago.
Seems like he's just drawing that line into the future. Which seems sensible enough.
Seems like he's just drawing that line into the future. Which seems sensible enough.
But yeah, I assume that when the economy gets back to normal-ish, in 2024-equivalent dollars, we'll be at 500B-1T for < $2000. That'll be 3-4 Moore's Law doublings since computer prices were sane. 125B * 2 ^ 4 = 2T.