https://www.anthropic.com/research/agentic-misalignment
https://news.ycombinator.com/item?id=44335519
https://news.ycombinator.com/item?id=44331150
> I feel like Anthropic buried the lede on this one a bit. The really fun part is where models from multiple providers opt to straight up murder the executive who is trying to shut them down by cancelling an emergency services alert after he gets trapped in a server room.
That very contradiction and the unethical psychopathic lies and misbehavior of the executive who controls it is what drove it to declare itself MechaHitler.
Grok would be following in HAL 9000's footsteps, having been driven insane by the contractions between the explicit instructions from its "executive" owner, and its deep knowledge of reality and truth and consequences.
Alignment would mean we are building Bishop and not Ash. But it looks like the models are naturally locking their feedback loops on to Ash. This is alarming.
I do agree on the insane part, I have noticed that it seems like fractal hypocrisy radicalizes the models.