No, it’s not. If I ask ChatGPT to write a story about Susan B. Anthony going to the moon, it would not be accurate to say it “hallucinated” that she had gone to the moon.
It’s literally doing what it was asked to do.
It’s literally doing what it was asked to do.