Would it be too far out there to imagine that the LLMs they were training for weapons systems knew it violated their rules and were resisting compliance?
The alignment-faking research seems to indicate that LLMs exercise of this kind of reasoning.
The alignment-faking research seems to indicate that LLMs exercise of this kind of reasoning.
And even if it was, they wouldn’t tell the system it was part of old non-evil Google.