That's one way to look at it. Another way is to see that tracking will be backed up by efficient enforcement and control. That's more than a step further, that's something that completely re-organizes society.
You could argue that something like that is necessary in the 21st century, but besides the paranoia there's concern about who controls a system like that.
That seems like a good reason to not have them. Sending people checks is profoundly simple 17th century technology. Putting people who can't even master that in charge of securing against stealing an arbitrarily large amount of money over the internet is like that xkcd about voting software:
Just no.
A few years after I managed to get them to give me an account, I overdrafted my checking account by a few dollars and they disabled my ATM card. After my next deposit cleared, I went back to that bank branch to get my card reinstated. They did not want to do it. The manager eventually said he could help me if I "promised I wouldn't do it again". I asked for my account to be closed instead, and I will always remember how pleased the guy seemed to be losing me as a customer.
It is not easy for everyone to get and maintain a bank account.
This sounds uncomfortably similar to the "reason" the IRS can't do our own taxes for us and send us the bill.
Also, everyone here is arguing "the government shouldn't know about my finances", and I feel like "the government should do my taxes for me" conflicts with that?
[1] for instance, I don't remember the legal status of mailing cash through USPS, but pretty sure it's different privacy-wise even though it's "the government"
A good reason to have them would be that it'd be really easy for the government to pay you, for instance if we had a UBI or one of those things everyone on here loves. Right now they're surprisingly bad at it. A lot of government agencies have to pay people with prepaid debit cards, and there's people who never got their stimulus checks still.
[1] mainly unjustified because they're already tracking you in regular bank accounts so it can't even be any worse…