I remember asking an earlier version, it might have been GPT-2, to translate a phrase into Klingon. It gave a different (presumably nonsensical) response every time you asked.

Since GPT is basically a text prediction engine that doesn't think, per se, this is a reasonable output.