Hacker News Reader

Comment by losvedir | Hacker News Reader

> Anthropic notified Philadelphia police of the incident on Wednesday Oct. 7, and the department met with the company’s representatives on Thursday, Oct. 8., officials said. Police then located the submission in the website’s tip records and confirmed the corresponding email remained in spam.

And later

> Those PPD safeguards limited the impact of this incident.

Ha, so the PPD safeguards is a spam filter? Claude emailed a tip and it went straight to spam, and nobody noticed until Anthropic realized what they'd done and reached out, whereupon they looked in the spam folder and said, yep there it is. Super intelligence, here we come.

View on HN

And, yet, I can't get Opus 5.5 to run analysis on a public data set without it complaining about all sorts of PII adjacent stuff.

Yep, they must be super serious about those tips.

That should be the much more important story that NBC follows up on...

The whole thing feels so fabricated. It’s hard to believe someone didn’t orchestrate the incident and then made a big fuss about it (to get attention about how powerful and scary their models are)

I can’t imagine anyone thinking filling out a form requires scary levels of power. It actually makes the model look incredibly dumb. It’s probably a real, stupid thing that happened.

> I can’t imagine anyone thinking filling out a form requires scary levels of power

You’d be surprised. However, the headline says “AI model submits false tip”, it doesn’t say anything about a form

The actual events might be dumb. The way they are presented and talked about are not

> “AI model submits false tip”, it doesn’t say anything about a form

The article mentions the website name in the first sentence, and it’s trivial to see that you submit a tip by filling out a form.

Who needs a System 1 model when you have a good ol Bayesian spam filter?

What’s amazing is that nobody would have even noticed if it weren’t for Anthropocene being all “LOOOK WHAT WE DIIIIID WE SENT AN EEEEEEEEEMMMMMAAAILL. SOOORRRY”.

Crying for attention in the attention economy has never been more pathetic, but I think it will get worse.

With OpenAI having all these 'rouge agents' around to pump their IPO, Anthropic must be feeling pressure to step up with their own army of rouges.

Along with "lose" and "loose", "rogue" has to be one of the toughest words for the internet. With all of the posts available publicly, it would be interesting to do an analysis of words the internet misspells the most often.

Ha, it's my proof that I am not a bot :-)

Reply on news.ycombinator.com