Post offices have to be able to handle money orders paid for in cash, so I guess they already have the infrastructure to do a significant subset of bank-like things. At least with respect to document authentication and cash management.

https://faq.usps.com/s/article/Money-Orders-The-Basics