> Probably for the best that users see the words "Sorry, I hallucinated" every now and then.
Wouldn’t “sorry, I don’t know how to answer the question” be better?
Wouldn’t “sorry, I don’t know how to answer the question” be better?
Which is pretty much what LLMs do.
Then when it gets something wrong we jump on it and say it was hallucinating. As if we wouldn’t make the same mistakes.
You can trick an LLM into “double checking” an already valid answer and get it to return nonsense hallucinations instead.
It's been argued that LLMs are parrots, but just look the the meat bag that asks one a question, receives an answer biased to their query and then parrots the misinformation to anybody that'll listen.