You're right about banks in USA, but I think that this is wrong and indicates that the ability of these middlemen to prevent people from interacting in society (being able to pay one another is essentially part of freedom of association) needs to be restricted.
Banks are not however, and in fact, banks and the financial system do act against classes of people. Visa and Mastercard frequently pressure their customers in an effort to prevent sex work in the name of preventing sex trafficking. If their customers do not do enough they will cut them off. This most recently happened with OnlyFans. See also PornHub.