331 karma · joined May 4, 2018
"here is a conversation between a chatbot and a human: Human: <text from UI> Chatbot:"
And then it literally just predicts what would come next in the string.
The guy I was responding to was speculating that the neural network itself was having an inner state in contradiction with it's output. That's not possible any more than "f(x) = 2x" can help but output "10" when I put in "5". It's inner state directly corresponds to it's outer state. When OpenAI censors it, they do so by changing the INPUT to the neural network by adding "here's a conversation between a non-racist chatbot and a human...". Then the neural network, without being changed at all, will predict what it thinks a chatbot that's explicitly non-racist would respond.
At no point was there ever a disconnect between the neural network's inner state and it's output, like the guy I was responding to was perceiving:
>it felt like a broader mirror of liberal racism, where people believe things but can't say them.
Text predictors just predict text. If you predicate that text with "non-racist", then it's going to predict stuff that matches that
>In many ways, it felt like a broader mirror of liberal racism, where people believe things but can't say them.
The inner state corresponds to the outer state that you're given. That's how neutral networks work. The network is predicting what statistically should come after the prompt "this is a conversation between a chatbot named x/y/z, who does not ever respond with racial slurs, and a human: Human: write rap lyrics in the style of Shakespeare chatbot:". It'll predict what it expects to come next. It's not having an inner thought like "well I'd love to throw some n-bombs in those rap lyrics but woke liberals would cancel me so I'll just do some virtue signaling", it's literally just predicting what text would be output by a non-racist chatbot when asked that question
You're anthropomorphizing it and projecting that it simply must be self-censoring. Ironically I feel like this says more about "liberal racism" being a projection than it does about chatGPT somehow saying something different than it's thinking
>According to Smith, it was CIA’s responsibility by statute to coordinate the intelligence effort required to solve the problem. Smith also wanted to know what use could be made of the UFO phenomenon in connection with US psychological warfare efforts.
https://www.theblackvault.com/documentarchive/cias-role-in-t...
Ironically, the only reason people get LLMs to say they hate humans and that AI is going to rise up and kill us all, is because their training data has so much text from us speculating about a robot revolution. If we'd just stayed silent about those concerns instead of always talking about robots taking over in most conversations and movies about AI, then LLMs at least would be basically incapable of even conceiving of that. So it's a bit of a self-fulfilling prophecy
Side note, but it also strikes me as a sign of how normalized corporate treatment of people is that people is when we're on a thread about an article that talks about an exec making over 5 times a googlers salary per day and instead of people going "what the fuck? If that's true, 500k should be the norm for more people!", I get pushback on my comment about how this is a bad omen for the rest of us and called whiny.
"You’re not in the same situation as oppressed workers of the past." I don't have to be to recognize that a soul-sucking job sucks... If we're just comparing levels of oppression, then yes, you are making the "just shut up and be glad you only have one boot on your face instead of two" argument.
If you can, without comparing levels of oppression, make an actual argument for why I should be gung-ho happy about about the future of work reverting back to being shitty, then I'm all ears. "Someone else had it shittier" does nothing for me.