You are oversimplifying their argument. People are suggesting that people use more than one bank or make a service that involves using more than one bank not necessarily infinite banks. It isn't necessary to choose between zero risk and existential risk. You can with only modest effort achieve moderate risk.