Also, you go to the bank to get cash? This may vary by geographic region, but where I live (NYC) there's I'm rarely near a place that doesn't have an ATM within a hundred feet or so.
Guess money could be counterfeit. But I've never encountered counterfeit bills, at least that I know of or that has inconvenienced me, and I haven't heard of it as a problem among the people I know who run cash-heavy businesses (mostly restaurants). Identity theft, however, is an epidemic, and has happened to literally everyone I know, except for (some) of the kids below the age of 14. Some of these cases can take years to clean up, and they often start with using plastic at a big chain, like Target or Home Depot.
Cards are nice for big purchases, like appliances or a large dinner out, or when shopping online . But cash is the thing.
Sounds awfully inconvenient. I'm constantly having to travel to the bank to get more cash, it's easy to lose, steal and destroy, the money I get in change might be counterfeit, it takes a lot more effort to track my cash purchases, and it turns out banks charge merchants a fee for handling cash too! (a local example of a fee schedule: https://www.oregonstatecu.com/business#/tab/fees)
Perhaps this all is a cost some feel is worth paying in exchange for privacy, but a cost nonetheless.