The same physical infrastructure that is also used for transporting just about everything else? Anyway, most currency transfer these days is digital, so even that doesn't hold much water.

You are conflating fiat currency and physical dollars. The total sum value of physical currency is much less than the total amount of dollars in existence. Most dollars exist only as entries in a ledger.