Agency is not granted. It is an inherent human atttribute, though its practical expression is heavily influenced, restricted, or enabled by social, political, and material conditions.

If in the exercise of your agency you create or release a generalized machine and allow it to become a meta-optimizer, then you are responsible for it, because it has not agency.