Hacker News Reader

Comment by jrpelkonen | Hacker News Reader

I feel sorry for the maintainers having to spend their energy disproving the validity of these AI generated reports. Daniel Stenberg blogged about this issue earlier: https://daniel.haxx.se/blog/2024/01/02/the-i-in-llm-stands-f...

Open source burnout is already real, I hope the volume of the AI slop security reports stays manageable.

View on HN

I really like his quote: "a well-formed crap report is harder and takes longer to discard".

I think that cuts to the core of why people feel betrayed when they suspect they're being fed unlabeled AI content. You see the well-formatted paragraphs, the precise explanations, and you naturally extend a bit more effort in reciprocation. There have always been junk bug reports, but they used to look like what they were.

Well i agree, in my experience in the past, lots of reports that looked like junk reports were actually real. I've seen lots of security reports with nonsensical explanations, very broken english to the point you can't follow, and then you run their PoC and it shockingly works.

Triaging security reports is exhausting and very hard.

A requirement for new bug reports: You must write unitelligible with werid spellin and less understend able lenguish. Try copy that, ai! Z)

IOW, older heuristics (meant to screen out below par human work) no longer function. Newer AI-specific heuristics are needed. Which is precisely what we're all developing, often without realizing.

Unfortunately there's a bit of a perverse feedback loop in that Pinocchio wants to be a real kid.

Reply on news.ycombinator.com