Hacker News Reader

A claim can be both statistically consistent with a given corpus and also simply wrong. Saying that Ted Cruz was caught giving blowjobs in an airport bathroom for instance. That headline wouldn't surprise anybody, but it's also wrong. I just made it up now.

View on HN

So then is that leftist to point out the fact that it shouldn't be surprising or just an accurate description of party members as a whole?

> So then is that leftist to point out the fact that it shouldn't be surprising

I don't think so, no.

> just an accurate description of party members as a whole?

It wouldn't be. While enough republicans have gotten caught being gay to remove the element of surprise and plausibly be the basis of LLM hallucinations, most of them haven't been, so such an LLM hallucination wouldn't actually be accurate, merely unsurprising.

I don't think there's any mechanism inside of language models to accurately weigh this kind of nuance. I mean you would think that it would work like that but I don't see how it could or would in practice. The quantity of words and relationship to their description of reality is not something that can be directly calculated, let alone audited.

Reply on news.ycombinator.com