LLMs hallucinate.
That's true and by how they are made it cannot be false.
Anything they generate cannot bw trusted and have to be verified.
They are good at generating fluff but i wouldn't rely on them for anything.
Ask at that temperature glass melts and you will get 5 different answers, noone true.