Frontier Models are Capable of In-context Scheming [pdf]
static1.squarespace.com
static1.squarespace.com
Interesting work on attempting to quantify misalignment. Keep in mind:
> Our evaluation scenarios are purposefully simplistic because we want to catch the earliest signs of scheming capabilities. This implies that the scenarios are quite toy and not representative of real deployments. For example, in our scenarios, situational awareness information (e.g., knowing about its goal misalignment and its supervision mechanisms) is provided very explicitly.
Related blog post: https://www.apolloresearch.ai/research/scheming-reasoning-ev...