Imagine running agents in the cloud to do simple stuff like extract one 3 digit number from a weather report for the temperature.
The power, cooling water and infra cost requirements are going to be huge.
That's the next step, is teach these massive generalized models to compile lightweight models (which doesn't have to be ML based) for narrowly defined tasks, validate the narrow model using the large one generating test data and boom, efficient code.
JavaScript (and web-age scripting languages in general) made programming more accessible in a fashion perhaps not entirely dissimilar to what we'll see with generative AI.
So, the flip side is that AI can clearly save enormous resources.
And how long will it be now before AI solves intractable problems like fusion energy, room temperature superconductors and perhaps even finds sci-fi tech like zero point energy?