AI hallucinations are the opposite of creativity. They give the most obvious wrong answer possible. For example, ask an AI about an unknown basketball player, it will probably describe it at fit and tall, because that's how we expect basketball players to be. That may be a good observation, but certainly not creativity.

If instead it told the story of someone short and obese, with details on how he got to play basketball, that would be creative. Of course, you can ask an AI to tell the story of a short and obese basketball player, and it will tell you a likely story for such a player, but again that's not creativity, it is just the AI filling the blanks based on whatever similar stories it had in its training set.