This makes me think a bit about John Boyd's law:
“If your boss demands loyalty, give him integrity. But if he demands integrity, then give him loyalty”
^ I wonder whether the personality we need most from AI will be our stated vs revealed preference.