Not that it excuses any condescension, but it's worth noting that all parents have had experience in both the "don't have kids" and "have kids" camps.

When parents talk (complain, whine) about how non-parents have it so easy, what they're really commenting on is the relative change in difficulty they experienced in their own lives when they switched camps, moreso than the difficulty of their life vs. yours.