I generally like online banks, but for me personally, I regularly have scenarios where I need to deposit hard cash. And so far, I've found the only way to do that is to have an account with a conventional bank or credit union.
One main reason is that I don't like the feeling of having all of my money stored by a single company. Especially if that company is operating with the goal of making profit. May be irrational, but having a single point of failure for all of my hard earned money just doesn't sit right.
My question could have been more specific - I see little reason to prefer a bank to fidelity.
It is government insured up to 1.25M though - so I think the risk is minimal short of government collapse.
In fact, bank credit cards are among the worst in terms of rewards. You'd be better off with a different one most likely.
You get a brokerage, you can have your retirement accounts there, you get free checks, debit card with free ATM access, software that's best in class for finance (even if it's still mediocre compared to consumer software).
You can configure automatic bill pay, automatic investments, free money wires to external banks to pay rents, no fees for anything really, no useless savings account or restrictions.
Even the phone support is better than any other financial institution I've ever had to deal with.
Zero fee total market index funds, no fees really for anything.
I think the only reason people don't use them is because they don't know it's an option and they use whatever bank their parents used.