That would depend on the bank and country. In the UK, for example, you can set up a direct debit and withdraw funds directly, using just the bank details. But you would need to have a UK bank account to do so, and they would presumably not just allow anyone to start running direct debits.