What I saw inside Anthropic: AI lab pushes towards recursive self-improvement
theargumentmag.com
theargumentmag.com
Reminds me of Daniel Ellsberg's advice to Henry Kissinger about how learning information kept secret from the public and even much of the government can affect your mind: https://www.motherjones.com/kevin-drum/2010/02/daniel-ellsbe...
> “In the meantime it will have become very hard for you to _learn_ from anybody who doesn’t have these clearances. Because you’ll be thinking as you listen to them: ‘What would this man be telling me if he knew what I know? Would he be giving me the same advice, or would it totally change his predictions and recommendations?’ And _that_ mental exercise is so torturous that after a while you give it up and just stop listening. I’ve seen this with my superiors, my colleagues….and with myself.