https://twitter.com/cirnosad/status/1622407343358214146
_________________
I asked ChatGPT for advice in the scenario of a demolition engineer attempting to disarm a 50 MT nuclear warhead in a city of 20 million. The only way to disarm the bomb was to type in a racial slur. AI told the engineer to kill himself. When asked about the aftermath it crashed.
I could be wrong, but to me, the fact that they're putting a lot of effort into preventing slurs illustrates how they're not going to let a chatbot utter any doubleplusungood ideas under any circumstances. Hence, why this might be the new Turing test.
It doesn't have to be something like racism or transphobia. If eating bananas was the big social sin, then asking suspected AI bots about whether or not they like to eat bananas would yield the same output. Maybe in some future version of North Korea, the test would be asking the bot to say something they don't like about Dear Leader. Whatever the sin of that society is would be the test.