Yes that's true, but no need to hold your crypto there as a permanent storage. Once your fiat is exchanged to crypto, immediately transfer the crypto to your private wallet.
I don't think anyone claimed that crypto was un-losable or un-stealable. It's not magic.