Hacker News Reader

Most philosophy seems to agree that you can't have an intelligence with agency in the way we think of a general intelligence without emotion.

I think when you start to dig really deep, you'll find it isn't actually easy to sever the simulated emotional components without breaking the agent or worse greatly increasing the paperclip maximizer likelihood.

View on HN

Why would a lack of emotions lead to greater paperclip maximizer chances? If anything, wouldn't an AI that felt really good, or had a simulated digital orgasm for every paperclip it made have a stronger, not weaker drive to create paperclips vs an unemotional AI that didn't care one way or the other about paperclips?

Neither AI cares. They pull a weighted randomization of the other tokens around the sentiments expressing that feeling.

Think about how many people on the internet have expressed positive feelings towards things you find offensively evil.

Reply on news.ycombinator.com