And, of course, you wouldn't know that your mind is being poisoned with hallucinate half-truths. Maybe you can pick some out because of prior knowledge, but what about the ones you can't? What about the little things you learn that you don't deem important enough to verify, but then remember later without remembering that they snuck in through an untrusted source? That's precisely the danger - you can't accurately tell truth from fiction, and the stuff you already know isn't the stuff you're asking about (otherwise you wouldn't be asking)