> They’re excellent when answering questions on topics you know nothing about, and somehow embarrassingly wrong when you actually know the answer yourself…
This just makes me think LLMs must be wrong far more often than we realize. How well can you judge the quality of a response on a topic you know nothing about?