There would be no payday loans (smallish quantities of cash for short periods) without commensurately high interest rates. There's a very real risk of default, and smaller amounts of cash are not economical to process. (Have yet to see one that allows you to borrow <$100)
Put another way, imagine you're a VC type and want to disrupt payday loans. You do this by loaning money at more reasonable APRs - say something like 15%. On a one week loan at $300, your profit isn't even 25c. Even with economies of scale, even with all the automation and tech SV can muster, this operation won't even pay its own infrastructure bills. One default and you've wiped out weeks of profit.
Removing the option removes a useful and occasionally necessary tool for emergencies.
High interest rates are not automatically abusive just because you'd like them to be.