Yep this is true. I work in online escrow. It's basically the original "smart contract", and until we are able to reliably digitize purchase events it's hard to beat. I have friends who talk about smart contracts, not understanding that it's currently very difficult for a computer to recognize events like "buyer has taken possession of merchandise", whereas it's pretty easy for a human.

It's just a useful feature the fiat system has.

The bigger point of crypto is that this trust can be parametrized and made transparent in a public ledger with less intermediaries. I see it as getting to feature parity, not as something that undermines trustless-ness - don't throw the baby out with the bathwater.