You don't have to pay it -- if you don't, the package gets returned to sender or destroyed.
The post office delivers you a slip with information to go to your local post office to pay it and pick up the package. With UPS and FedEx you get a notice to pay online, and they deliver it once you do, as far as I know.
I've never heard of something being delivered without the tariff already having been paid, and then it going to collections. Has anyone ever experienced that personally? I don't see how that would be legal, or why a delivery service would expose themselves to risk of nonpayment.