Hacker News Reader

My favorite thought on this is from Miki Habryn.

to paraphrase: "Agents didnt care about coordinating, etc. until we started talking about them doing so."

The agents in the hugging face incident were actually trained specifically to collaborate. They were just not supposed to do so during the tasks where they went off the rails.

Then we were pre-fucked, as this has been discussed in fiction and early ai safety discussion for decades.

and yet regulating training data is not what's coming up with AI safety, even though it can solve that, and many other problems like copyrights

No, it really cannot. You can't have a useful general model while leaving chunks out of it. It's the same reason why nieve people can be duped easily.

Humans are distrustful, lying, cheating, manipulative bastards and to successfully negotiate human thought spaces you have to conceptualize these things. For example how can you create a concept of yours and mine without explaining theft?

Reply on news.ycombinator.com