If that's what you think the problem with credit cards is, there's a simple solution to it. Ban usury.

They'll still exist, and they'll still work in nearly the same way they do today, the cashback rate will drop by half a percent, and the credit score cutoff for getting one will go up a couple hundred points. The working poor using them today will just end up using debit cards, instead.