The difference is computers post text terminal are latency and throughput dependent to the user. LLMs are not particularly.
I can easily see the advantage, even now, of running the LLM locally. As others have said in this topic. I think it'll happen.
edit: thanks for clarifying :)