"AI people" do understand that LLMs "hallucinate" by design. Rather, critics see hallucinations as a problem for applications that inherently require factual accuracy (e.g. Galactica should not hallucinate; summarization should be factual, etc.).
Indeed, one could make the case that LLMs are fundamentally unsuited for many of the tasks they are currently being marketed for.