It should only hallucinate when asked. Humans can do the same but when humans mistake their hallucinations for reality we usually consider it problematic. Especially if the AI is going to be considered a reference which many seem willing to believe.
Most of the time, we don’t notice, and the popular perception is that it happens vastly less than empirical testing has shown it does.