Truthfulness is on totally different philosophical footing than consciousness, so the analogy doesn't hold up. There is no "hard problem of epistemology", but there is a hard problem of consciousness. There exist criteria for evaluating truthfulness (that we may reasonably disagree on) that can be applied to LLM output.