Sure, keeping your BTC in an exchange's account may make it faster to exchange your BTC to USD, and you may see less transaction fees, but at the end of the day it means you have to trust the exchange to do the right thing.
Want to keep your coins safe? Secure your wallet.dat.
Placing your BTC in an exchange's wallet means you are trusting that exchange. I don't really trust exchanges -- I still use them, but I never transfer extra BTC in, and I always transfer 100% of the BTC I buy into my wallet.
After the Mt. Gox hack, it came out that many people were buying BTC and leaving it in Mt. Gox' wallet. That's a colossal mistake; there is simply no reason to trust anyone else to hold your BTC.
Bitcoin exchanges will always exist and need to be secured. Bitcoin banks serve no purpose and should never exist.
Perhaps there is no way to build a sufficiently secure untraceable, non-undoable cash system.
I am not sure, but I think Bitcoin transactions can be reversed, too, if enough nodes want to do so.
The moral of the story is that you need to be careful about where you place your valuables. Don't trust a service that hasn't been thoroughly tested and audited if you are going to store a large amount of money there.
There are various folks who provide pre-configured VM's for things (jumpbox [1] comes to mind) so presumably they could provide a site that was at least moderately safe. Of course that means money to pay for that sort of stuff.
I've not been following bitcoin closely, mostly just seeing the major screwups. But has anyone even started the process of a 'best practices' tutorial on keeping a bitcoin bank secure? (and these are depository banks, call them 'enthusiast websites' all you want but if they 'hold' a quantity of a good for others which has monetary value then they are a depository and should arm themselves appropriately)