Assuming it didn’t just start hallucinating plausible sounding phrases
In the event that an artificial intelligence does get released into the wild that people lose control over, we will never know what is hallucination, and what is real when interacting with it.