I've had to call my bank and they had a very hard time unapproving someone after I'd given them deposit permissions but ended the business relationship.

It was weird. They seemed very confused by the request.