You are supposed to preface it with how Altman is making AI services, selling them as AGI, and also painting AGI as a danger to the survival of humanity. Then, when they are baffled at why someone would sell something while describing it that way, you can walk them through regulatory capture and erecting barriers to competition.
OpenAI markets their product exactly this way, focusing on how ChatGPT can 'write code' (it cannot) or 'write poetry' (it cannot) or do any number of things that lean in hard on the 'stupid AGI' angle, never clarifying that their actual product is a spicy autocomplete. You'll never hear OpenAI say 'ChatGPT is a stupid AGI' out loud, but they'll never correct any mainstream misunderstandings that it is.
a lot of the dismissive takedown of LLM's intelligence uses their spurious knowledge of the world, but it is quite easy to have them 1. search the internet 2. search research articles 3. read books and have them work to iteratively improve something.
Right now they cannot do much reliably but calling them a parrot is miopic how little we understand how humans are intelligent and to how LLMs today are more intelligent than a non negligible chunk of the population.
ChatGPT can “write code” in the most literal sense that it will give you code when given a prompt, but (unlike how OpenAI markets-by-omission) it does not reason about code like an AGI could.
btw, i think i have tended to see these pessimistic takes by people who have only used 3.5, which is impressive but not reliable -- i strongly recommend using 4 in the course of your job to see how useful it is. every day in the course of interacting with it, it produces novel lines of thought which shock me.
Here's a recent example: https://simonwillison.net/2023/Aug/6/annotated-presentations...
> Creating safe AGI that benefits all of humanity
In big letters.
They are very clearly playing the game of positioning themselves as the AGI good guys, and at the same time Sam Altman has been encouraging the view that AGI is dangerous.
Regulatory capture.