>such a good job of masquerading as human thinking indicates that much of human thinking isn't much more than that.
No, that doesn’t follow. It just means it roughly looks like human thinking.
Your comment is akin to saying a high resolution photo of a human has basically figured out a way to replicate humans. It looks like it in one aspect but it’s laughably wrong. Humans thought without language.