> Which honestly is still good for the environment to have the work distributed across the entire electricity grid.

Sometimes, but parallelization has a cost. The power consumption from 400,000,000 iPhones downloading a 2gb LLM is not negligible, probably more than what you'd consume running it as a REST API on a remote server. Not to mention slower.