That’s the SV sci-fi fantasy to World Domination via LLMs, which is actually a delusion.
There is a huge gap between an AI doing a specific task better than all humans and AIs working on all the tasks humanity needs. Humans do trillions of those tasks everyday.
Yes, this is another goalpost, but it’s nowhere in sight.
Human race is huge. Even if we focus only on compute, human race has 8 billion AGIs, each work with very little power. Yet sustaining energy (food) for human race is a real problem.
The main fallacy here is setting some variable to infinity in a back-of-the-envelope estimation. But there is no infinity in the real world and things don’t have to scale as predicted.