There are plenty of people who don't drive and currently have to pay a slight premium for a parking space they don't use. The market currently cannot efficiently serve those people. I am one of those people. Removing parking minimums helps people like me, and honestly doesn't effect people like you. Just because such a change wouldn't do anything in particular to help vehicle owners doesn't mean it's going to hurt them either.
This is called 'displaced parking' and it's a pretty well known problem among parking planners. You'll get the same thing if, for example, the college campus starts charging $5 to park when students can park for free on nearby streets and walk.
You can get around this with parking permits and towing everywhere in walking distance - but you can't be timid and imagine the new street won't interact with other parking locally.
People are just trying to live their lives. Inconveniencing vehicle users won’t actually change anything because they have zero power over the “vision” of their area and zoning. The change has to come from the city planners first.
I would love love love to not need a car. And my area is pouring millions in mixed use land projects to make it happen. It’s a decades long project.