As Terry Tao said, LLMs are not outsmarting us, they are out remembering us.

I'm fairly sure your understanding is not fully accurate.