You are creating a log of "everything you do", available to third parties, both statal and private. «That's probably» more because of lack of sense of "creepy".
And «that's probably» also because you are not considering the infrastructure required, such as that time in spring the shop owner in front of me was having a nervous breakdown as a blackout had his transaction equipment off. In normal times you give a banknote, take change and the fiscal registration will be postponed to after the blackout. In cretinous times, there will be no purchase. I was there to buy water.
"What if the power goes out" is a question that needs to be answered for any part of society relying on technology, which, with the rise of ICS and IoT systems, is already affecting everything around us. Bridges will be stuck open (or closed), train will stop and grind to a halt, the shipping industry will grind to a halt, hospitals won't work for more than a day, electric cars will be unusable even sooner, the list goes on.
Good digital and electrical infrastructure is far from available everywhere, and in areas where it's not, a completely cashless society is simply not a good idea.
which boils down to: "a cashless society can work well because we can use tech to make society cashless."
this is not a substantive argument.
However, I don't see any cashless society working well with credit based systems, simply because of the credit score/debt history connection.
Cash is just an IOU for the bank that can be devalued at any point in time. If you want to avoid government oppression, go back to bartering rare metals. "Yes but what if the government turns oppressive" isn't an avoidable scenario, cashless or not.
However, that's probably because I live in a debit-based country. Debit cards without overdraft capabilities should be readily available even to people with no financial skills because you can't use them to spend more than you earn, making the risk to the banks themselves minimal. The small fee paid for banking services is the only thing at risk and even that won't have much of an impact on the bank in general.
Some countries, most importantly probably the USA, almost exclusively operate on credit cards for digital money, which are practically quick instant loans that you don't want to think about. There's very little in there to limit your credit card spending to your actual income and some people are foolish or desperate enough to borrow money to pay off loans, with credit cards being one of the easiest options. People with poor or no financial skills will run up a debt and quickly stop qualifying for credit, and the end result is that they're dependent on cash or even something as archaic as cheques to transfer money in stores. The extreme impact credit scores can have in the States is mind boggling but it almost looks like people accept some shady third party evaluating their entire life for fraud risk as a normal thing.
If your standard modus operandi is spending money that you'll have to pay back later, I don't think your society can be cashless. Normalise debit cards as standard payment systems and almost everyone can qualify. Frauds will find themselves struggling to get an affordable bank account, but in a modern banking system there are plenty of alternatives available.
Based on this article, Canada clearly needs a banking overhaul for any cashless ambitions to stick without dire consequences.