I'm writing from the UK where most credit unions don't offer interbank transfers or cards. If you need somewhere to stow cash, it is likely they won't be as heavily overseen by regulators here. Some are less basic but many are, I suspect, small enough to fly under the radar.