The internet also delivers mostly spam, and is still a public good.
The USPS needs reform, sure. But a public postal service which will deliver mail to everywhere, even at a loss, is fundamental to civilized society. Prior to the internet, this public good was more obvious. It's still needed.
Amazon delivers efficiently to 95% of addresses, so long as there's a profit to be had, and this is good for buyers. The USPS delivers to 100%, regardless of profit, and this is good for citizens and businesses - bills, legal documents, ballots and governments' communications are receivable at nearly every address in every state, thanks to the USPS. That's a tremendous public good.
If there were possible to talk about the American postal service non-ideologically, it would be a cinch to regulate away most junk mail, I imagine. Political oversight has in recent decades demanded the USPS be profitable, which misses its point.