> He doesn't say anything about individual users. It's left unclear exactly what he means when he talks about low utilization inference using DRAM. I figured he was talking about companies building clusters.

No, he absolutely does:

"From a global allocation perspective, actually, it's quite terrible to have everyone have a bunch of the world's limited supply of DRAM sitting in their own computer. And be used 5% of the time," Altman said.