I wasn't really thinking about single men destabilizing a society. Just an idea that mixing genes up more in children may be good for that society, and that anything that reduces this mixing may be unhelpful to a society.
I see both monogamy and preventing cosanguinity as examples of actions that could increase this mixing.