TFA is short and only shows a single example, but it illuminated something for me. LLMs are a misnomer. These are Large Text Models, or better yet, Large Token Models. The appearance of Language is a result of embedding words or parts of words into Tokens, then identifying the relations between Tokens via Machine Learning.
This further solidifies my view that LLMs will not achieve AGI by refuting the oft repeated popsci argument that human brains predict the next word in a sentence just like LLMs.