Yeah sure. ChatGPT confabulates constantly and has no understanding of what it's saying. I think it fails the 'I' part of 'AI.'
I've had it confidently invent URLs when challenged to show the sources for an obviously false claim. It invented a URL which has never existed.
I mean it's impressive, but it has a long way to go to become intelligent.