"A lot of people want local inference. And somehow, they assume that like the problem is solved now. Because we are going to have open-source models. We're going to be able to run them on our computers. And so we're not gonna need all the stuff in the data center. But from a global allocation perspective, actually, it's quite terrible to have everybody, like, have a bunch of the world's limited supply of DRAM sitting in their own computer. And being used 5% of the time."
I've seen the video where he says those words out loud, on mic.