Well, bank lending creates deposits, so they need to deal with deposits to actually be a bank.

There are non-bank lenders (and non-bank payment services companies that offer prepaid visa/mastercard products), but they ultimately are then customers of the bank and they are much more limited in what they can do that banks are. That's why it's crazy difficult to get a banking license.