Not being selected isn’t a punishment. We are not entitled to having everyone find us attractive. We are not even entitled to having a mate. There really may not be someone for everyone.
If you have very unattractive qualities and because of that people are not selecting you, they are not punishing you. If someone doesn’t want to be with you because you admit you’ve cheated in the past but don’t plan to anymore, that is fair. If you carry genes that make you more likely to seek out other partners and they don’t want that, that is also fair.