One can be tested and improved upon, the other can't. Just don't sign me up for a face punching trial.
Most people grossly underestimate the forces of genetic drift and personal preference on phenotypical evolution. The null hypothesis for any gender-linked trait having evolved should probably be "it made them more attractive to a fertile population of the opposite sex."