It would be wonderful to have a BTC bank account with an insurance policy denominated in BTC, but that doesn't exist yet (AFAIK). Until then... Not your keys not your coins.

Also, you don't need to store them on your PC. There are also paper wallets, hardware wallets, or you could put your wallet files on a flash drive.

> I'm just happy what I was wise enough not to put more money in bitcoin than I could afford to lose.

That should be the default for ~any investment.