They are also granted a monopoly on delivery of mail to your house mailbox.
The flip side is, UPS and FedEx can refuse to deliver to certain addresses. The USPS can't.
tldr; I hate junk mail and will scream into the void about it.
I guess they have to make money somehow.
USPS and FedEx are nice, but are more expensive than the USPS. And there's that whole rain, snow, sleet, or hail thing.