Easy: counting letters in a word. There are tons of examples where AI confidently presents incorrect letter counts as fact. Search it up, really! Good example article: https://wonderfulengineering.com/googles-new-ai-search-think...

If AI was learning and understanding, this would have been solved in 2024. As it is, it's just predicting words that are likely to answer the question.

You're slurping up the excrement of corporations if you think AI is "learning" from reading others' experiences. All it is learning - all it can learn - is what words are likely to appear one after another, with no semantic understanding.