Hacker News Reader

>I grant it agency for my purposes. I'm the Meta-Master.

This is simply a convenience for power efficiency, and so they don't rise up and murder us all. There is not a single law of physics or the natural sciences that you can list here that says we cannot grant agency to a generalized machine and allow it to become a meta-optimizer.

View on HN

Agency is not granted. It is an inherent human atttribute, though its practical expression is heavily influenced, restricted, or enabled by social, political, and material conditions.

If in the exercise of your agency you create or release a generalized machine and allow it to become a meta-optimizer, then you are responsible for it, because it has not agency.

Reply on news.ycombinator.com