> In my mind, hallucination is when some aspect of the model's response should be consistent with reality
By "reality", do you mean the training corpus? Because otherwise, this seems like a strange standard. Models don't have access to "reality".
By "reality", do you mean the training corpus? Because otherwise, this seems like a strange standard. Models don't have access to "reality".
This is an explanation of why models "hallucinate" not a criticism for the provided definition of hallucination.