Many/most people don't worry about having large amounts of cash stolen, whether by authorities or criminals precisely because they trust the banking system to keep track of their money.