So when I go buy a device, I pay some extra amount, enforced by the state. I can then get that back (a deposit, or dare I say, refund), when I return the battery.

I'm not saying I don't like the idea, but this is a tax with a different name. And we haven't even gotten to how someone pays for the infrastructure for all this battery cleanup.