Isn't "Never carry your social security card in your wallet" standard advice? I was taught that since I was a child, before identity theft was even really a mainstream thing.

As to credit cards, if your wallet is lost or stolen, you can quickly cancel the cards. It is probably more difficult to quickly change all your passwords.

Keeping them in a safe, however, is probably a fine idea. Potentially a good one if you want people to have access to certain accounts if something happens to you.