GPT is highly general
We have a _very_ long way to go to AGI. Diluting down the meaning of the term "AGI" just to say we've reached it is, almost literally, moving the goalposts.
... not that I don't disagree with the rest of what you think you've said here, but I think that this part of your claim is egregiously paucious.
For every 20 paragraph thesis about the world around us, how often do you think someone meaningfully innovates and changes meaningfully our understanding of the world around us, and it's fundamentals?
Consider, like, classical logic. It's pretty much done. You have the universal gate sets, and any novel functions are just going to be an mxn-mux. Most other such general concepts are essentially figured out and have had their applications recorded, explained, demonstrated.
Sure, biographical information and history changes on a whim, but no one is requesting artificial clairvoyant intelligence.
I suppose you could have the model pontificate and assess the truth of its own argumentation (ask it to generate outer-product concepts, ask it to reassess assumptions in current models) but it will quickly learn its own language that will be mutually unintelligible with the corpus of current human knowledge it has been trained on.
Why does the underlying model need to change on a whim, in your opinion?... on what whim?
It’s not only textbook ‘confidently wrong’ (which is easy when you have strong opinions in a rapidly moving field) it also is a great counterpoint to ‘but LLMs hallucinate” because humans do that all the time too as seen here.
Spoiler:
- GPT4 can be given arbitrarily large long term memory via tools/plugins, vector stores, etc. It matters not whether that’s a feature of the model or an external tool made available to it, the result is the same.
- It’s completely unbounded by what it was trained on because it can be given tools to access any data, from google to specialized databases. It matters not if it has that feature in the model or it was made available to it as an external tool
- It can absolutely prioritize and plan, you literally just have to ask it and loop on itself. You missed LangChain and ChatGPT plug-ins to only name a few prioritization frameworks.
- There is absolutely no evidence that it cannot be creative and plenty evidence to the contrary. To deny this one has to create a definition of creativity that excludes AI. With access to an almost infinite supply of cultural information, it can expose you to novel ideas reframed given the right set of tools and temperature.
Sure we can pretend there is a universally accepted definition for AGI and even pretend it’s the one you have chosen - but it’s like arguing with a Taifoon on whether it’s a Hurricane. In terms of outcomes - all the same.
GPT-4 can't perform simple classical planning tasks so it's doubtful that it can "plan" in a looser way, as I think you mean it: