Personally, I think that phenomenon (along with "hallucinations") is fundamentally baked into LLMs writ large.
I think LLMs are a dead end on the path to AGI.
I think LLMs are a dead end on the path to AGI.
I think hallucinations are a major unsearched gateway to AGI.
Not only humans hallucinate all the time, humans also have persistent hallucinations as evident from the presence of opposing beliefs in various slices of society.