I dunno, maybe democratic input into deciding these values? If these machines are going to be as revolutionary as anthropic says such that they risk killing all of us then I think it is rather important that we don't have a CEO-king deciding this for us.