Not if the ai is hallucinating. Imagine if your doctor was extremely knowledgeable, but extremely high on acid every day and prone to confidently lying to you
Furthermore, what are the odds that an ensemble of 100 models whose output is ranked / voted / etc will be wrong?
What if we used LLMs to guide the search and ask questions / order and rank exams and analyses?
This brings us to the bitter lesson, we can scale LLMs and compute far far far better than we can scale humans.
As long as we can use compute to scale search and learning from data, we will keep making progress.
Chess was unsolvable, Go was unsolvable, Starcraft was unsolvable. We will get there.