I feel that if people are used to moving around their lives, they can continue to do so even in old age, like taking stairs every day on a 4th story walk-up with bags of groceries and goods.
Anecdotally, I feel the rise of the automobile coincided with the fall of general health and mobility of senior citizens.
You need a system which has at least a rational level of support for people who are elderly, infirm, or otherwise physically disabled.
We already exempt them from various driving rules, such as parking restrictions. We already have special transport services just for them. No one is suggesting removing these.
That's a fair argument. I think a car-less future for urban centers is a good goal, but you need a huge transit infrastructure that I don't think most (any?) cities have right now to support it. Permitting is a transitional tool to enable a gradual phase out while letting the polluters/accident-causers etc. pay for the costs they're putting on the rest of us.
Two of my grandparents drove everywhere for decades, retired, still drove everywhere, then had huge trouble with their joints etc. When my grandmother lost her license (worsening eyesight), she was very isolated.
My other grandparents had nice cars, but also made good use of their pensioner's discount/free transport pass. My grandma would take the train across a large English city to visit her sister or friends. She's in her late 80s, and still very mobile, although no longer independent.
I prefer a ban, as it's fairer to everyone. There are externalities that are very difficult to price (pollution, accident risk), and just being rich doesn't give people extra rights to poison the air and kill/injure people. It also ensures rich people use public transport, so they have some incentive to make sure the service is good.