This is definitely true.
>but to the extent we do, LLMs are by far the closest implementation of those same ideas in a computer
Well - this is half true but meaningless. I mean - we don't understand so LLM's are as good a bet as anything.
LLMs will confidently tell you that white wine is good with fish, but they have no experience of the taste of wine, or fish, or what it means for one to compliment the other. Humans all know what it's like to have fluid in their mouths, they know the taste of food and the feel of the ground under their feet. LLMs have no experience, they exist crystalised and unchanging in an abstract eternal now, so they literally can't understand anything.