A driving license is a privilege that comes with rules, taking it away is not the same as imposing unilateral restrictions.

Sending people to mental hospitals is a fair example, but that's why I wrote "generally", acknowledging the existence of exceptions. In that case, it's accepted that consent is an oxymoron, which doesn't really apply here.