That's how it works in Europe (SEPA mandate) and it doesn't appear to be a problem.
In Germany, very few people have credit cards, and mostly for online purchases. Everything else is done via direct debit. Fraudulent charges can be reversed just like a CC payment.