Let's put gaming and all the other uses for compute that require low latency, etc. off the table and just talk about AI compute. People can and do run open models on their own hardware. Altman is, not unseriously, arguing that this hardware would be better utilized if it were concentrated in data centres rather than distributed into smaller, private clusters that might not reach full utlization.

Now, let's take privacy concerns off the table. OpenAI's complete lack of respect for privacy, authorship, copyright, etc. mean that you simply can't entrust private data to OpenAI. Full stop. Anyone with privacy concerns gets a free pass.

Finally, we're dealing just with people doing LLM computations on data that's not sensitive. Why aren't these people doing things in data centres? There are likely a variety of reasons, but one is likely price. If somebody does a lot of stuff with local models, they've probably found an application where a bigger closed model doesn't offer compelling advantages and the cost, purely in terms of filthy lucre, of running a local model is lower. These are the users Sam Altman can legitimately target. What Altman is arguing is that these people are paying too much.

How should he target them? Become the Steam of compute. Save them money and time. If Altman wants these people's RAM because he can use it more efficiently, he needs to offer them the same services they can get from their own hardware, cheaper, and with less trouble.