Men's preferences only matter in a monogamous society, where less attractive women are expected to settle down with less attractive men who will financially support their kids.
But in modern welfare states, less attractive women can still sleep with very attractive men (whom they could never marry), have their children, and rely on the state to financially support their kids.
Which means the rich but unattractive men are, through taxes, paying for the children of the attractive men.