Again, you are not accounting for rape in war. Which the "unsuccessful men" on the winning side will do. Just look up conflict in Africa, rape is being used as a weapon.
These pressures are much more pronounced in polygamous societies, such as fundamentalist Muslim countries today, or ancient Jewish culture as documented in the Old Testament.