If my credit card gets stolen then I just report it to the credit card company and I get a new card (free) and all of the fraudulent charges reversed. If the bank goes under, my funds are insured by the FDIC. If I lose my wallet I can report that to my banks and get everything (except the cash in my wallet) restored to pre-loss state.

If my Coinbase wallet account is hacked because I use a bad password, can I get anything back? If Coinbase as a company goes under, what happens to my bitcoins? If I accidentally send cryptocurrency to the wrong recipient, how do I reverse that transaction?

As somebody living in the USA who doesn't transfer funds internationally, I'm quite well covered by existing banking regulations: I'm struggling to see how Bitcoin is 'safer' for me in any way.