Taxes do unjustly (sexism, dick tax) punish single men, but the marriage deal is even more disadvantageous. Most marriages will end in divorce, and most divorces will end up very unfavorably for men.
Thus avoiding marriage stands to reason.
There should not be a legal concept of marriage to begin with. The state should just treat everybody as individuals, and end this anachronistic insanity.