The institutions ought to be under democratic control in the sense that they are regulated by elected representatives. If they are not, then that is a big problem which should be fixed rather than circumventing the institutions altogether.

Physical cash is de facto restricted in many places in the form of upper bounds on the amounts that one can withdraw and deposit.

No they aren’t. There are laws requiring documentation of cash transactions over a threshold.