I believe that LLMs will eventually be a small component of AGI; most likely it'll function like the Broca's region of the brain.