paulsutter said:
> Note that this is the single most human attribute of LLMs
It might be if LLM hallucinations looked like or occurred at the same frequency as human hallucinations do, but they don’t.
It might be if LLM hallucinations looked like or occurred at the same frequency as human hallucinations do, but they don’t.
Compare the hallucination behaviour of a 7B model with a 70B model and then GPT4 and you'll quickly see the frequency of hallucinations right now doesn't mean much.
By analogy to Kahneman and Tversky's System 1 and System 2, the whole field of Prospect Theory is about how often System 1 is wrong. This feels connected.
Yesterday I read "Building a deep learning rig" as "Building a deep learning pig" at first for some reason I can't explain...