Exactly this. Psychopaths may not have empathy or desire for social approval prevent them from becoming murderers, but they still don't want to be punished or become outcasts and lose all the things they need from society. They can even develop their own rational morality, arguably in many ways better than the instinctive emotional morality most people have.
Psychopaths typically only become murderers if they're either stupid, live in a defunct society or have some other metal issue that compels them to kill. Fortunately, that combination is rare.