Studies have shown that perception of attractiveness changes when people get to know each other better (they rate each other more attractive). Most men are ugly anyway - and women see it as such, too. Their perception of male attractiveness follows a power law, whereas male perception of female attractiveness is a normal distribution. Meaning most women only consider few men attractive, whereas most men consider most women attractive.

As a man, if you can get the basics right (personal hygiene, good clothes), you are already in the top quantile. Bummer about the height, but there are also women who are not very tall.