Some people further want the Bernie Sanders plan of having post offices do banking (including such short term loans), so the lines can be choked with people trying to figure out banking while you just want to pick up your package.
This is just cowardly defeatism, a trend all too common these days in American public policy. Too many ideas which are provably sound as borne out by their implementation by other nations (cf universal health care for another example), waved away as "impossible" (or at least, impossible in America) by much of the electorate.
Too many Americans like yourself are too quick to grasp for any excuse they can which will allow them to perceive a real weakness (shitty health care is the big one, but also failing institutions generally) as an imagined strength. You can fool yourself for a very long time, but you don't solve any real problems that way.
The studies referred to by fennecfoxen show that payday lending is extremely competitive: http://fee.org/articles/busting-the-myths-of-payday-lending. That's why the margins are so thin.
You're not talking about government "competing" in this space. You're asking for the government to subsidize payday loans either directly or across borrowers with different credit ratings (like the government does with student loans).