That's not a good analogy. Trusting an LLM right now is more akin to trusting a compulsive liar. (Another approximation would be assuming historical fiction was true.)

Humans usually try not to lie, and there's a particular shape to the sorts of details they tend to forget / confuse. Compulsive liars often don't even notice themselves lying. That's closer to an LLM. I trust the output of an LLM about as much as stuff George Santos says.