The only counterpoint I have is that it seems the gpt models have trained on most available information on the Internet. So what’s the future progress there exactly.
I think that would be about five times faster than a human.
But there is more data. Do you really think they have ingested every single YouTube video or movie? Video and video+transcription is the next thing.
Another source of data could be to have the models study and reprocess information into more concise language (possibly new vocabulary) or diagrams with the goal of increasing levels of abstraction or information density.