I once asked an earlier version of GPT a question that it was never asked before, and it will never be asked again, and it gave multiple imaginative and plausible answers to it. It's not a bullshit machine.
Giving imaginative and plausible answers to something you know nothing about is the definition of bullshitting.