Yeah I'm surprised that there's not at least some sort of conviction metric being outputted along the LLM response.
I mean it's all probability right? Must be a way to give it some score.
I mean it's all probability right? Must be a way to give it some score.
I think the closest you can get without more research is another model checking the answer and looking for BS. This will cripple speed but if it can be more agentic and async it may not matter.
I think people need to choose between chat interface and better answers.