No, anyone’s account can be debited from, but only specific accounts can be debited to.
I can’t pull money from your account, even if you tell me your IBAN.
But I can use your IBAN to order from amazon, and then amazon can just pull however much they want from your account.
Luckily chargeback with direct debit works just as fast as with credit cards.