Being a public ledger doesn't mean your real world identity is automatically connected to a crypto address. In practice most people aren't diligent enough to separate the two, but it's possible.

And then you have private ledgers like Monero.