I don't think the model of highly concentrated data centers makes a lot of sense. From a security standpoint, you can target them easily. It's better for everyone (except perhaps a handful of elite power-mongers) if the hardware is distributed among the populace. I've pushed for something like this before, where each home has a 128GB+ powerful computing rig they can use to run LLMs, generate images and whathaveyou.

I get why the people in power want it, you can concentrate dependence on your asset, do surveillance and industrial espionage. But it's so obviously better to have the power distributed out among the people that it's a no brainer for the average joe/jane.

No doubt, there is still a need for large datacenters to generate models, but we should be looking to a more sustainable/distributed approach when it comes to inference, or running the models. That way people can keep their data, not have their ideas ripped off, not be subject to the whims of whatever policy some technocrat dreams up and not be shit out of luck if someone strikes us-east1 or some such place.