In the end I think LLM's will not be used on their own much, and instead more as glue for bringing together a whole bunch of other technology and allowing it to be coordinated with plain English.
Microsoft researches just put out a paper about 'proto-AGI' in the last 24 hours or so, and tool use was a big part of the paper.
That "glue" is a superpower.