> LLMs comparable to today's state of the art are going to be running on $1-2K machines in a few years
This is a huge claim. What makes you think this will be the case?
This is a huge claim. What makes you think this will be the case?
Seems like he's just drawing that line into the future. Which seems sensible enough.
But yeah, I assume that when the economy gets back to normal-ish, in 2024-equivalent dollars, we'll be at 500B-1T for < $2000. That'll be 3-4 Moore's Law doublings since computer prices were sane. 125B * 2 ^ 4 = 2T.