> ... if you have the capital and do the paperwork and follow the regs, you can start a bank and get access to the discount window.

Not true. There's this little extra step where first the regulatory authority gets to decide whether your state needs another bank.