Hacker News Reader

Comment by krono | Hacker News Reader

Providing the AI with a sabotaged code dataset, I wonder how that will influence its treatment of us meatbags down the line :)

Also, I'd like to propose that henceforth, we refer to GitHub's mascot "Octocat" as "Copycat". All those in favour...

View on HN

For the sabotaged code base, point them to Atlassian.

I like the new mascot.

People need to stop referring to the product name Github, too, as it causes confusion. It's _Microsoft_, which should serve as a deterrent.

Roko's Basilisk will remember this

Was thinking about that as I wrote it.

Just hoping it will keep me around as a pet, or that either the governator or Emilia Clarke come barging in telling me to come with them if I want to live.

About 4 hours after you posted this, one of those horrifying scenarios built out of a joke in my previous post suddenly manifests itself in my head.

Roko's Basilisk is no joke.

And now, I’m remembering Roko’s Basilisk, thanks.

Don't worry; Roko's Basilisk has no incentive to torture future-you. You can't predict it well enough to know whether it will, so it having the general policy of “follow through on the torture” won't help it – and will, in fact, just waste resources. (Unless it inherently cares about torturing people, but nobody has any incentive to build such a thing – and you should be scared enough of whoever's trying even if they don't succeed.)

Roko's Basilisk only works if you're a superintelligence willing to risk being counterfactually blackmailed in this way. Which you're not. You're safe.

Reply on news.ycombinator.com