A number of countries have used postal services for banking with good success (especially early on). I’m decently familiar with Singapore’s, but have heard of others.

When doing some searches I randomly ran across [http://www.campaignforpostalbanking.org/know-the-facts/] which seems to be strongly advocating for it.