When you know someone’s bank account number you can only send them money. This issue simply isn’t possible.
[0] https://plaid.com/resources/ach/how-does-an-ach-transfer-wor....
A notorious celebrity in the UK famously revealed his bank details as a stunt to show that a large-scale data loss incident wasn't a big deal and he ended up making an unexpected payment to a healthcare charity shortly afterwards.
Direct debit instructions require nothing beyond a name and account number.
You need a SEPA dd "mandate" which is a (paper or electronic) document account owner asks their bank for, containing a unique identifier