It seems to be mostly tech workers who pine for the "buy it now" experience for car shopping. They all seem to know exactly what make, model, and color they want, and they never buy used.
Everyone else has a budget, coupled with a wide range of what they consider an acceptable car - which is why test driving and "show me what else is on the lot" will always be a thing.
You're describing a regular garage here. We have those on most corners. Some also sell used cars btw. The argument is centered around the sales activities, hence the comment.
And most dealerships strive to make the service part of the equation very pleasant to keep you coming back. You will get a work area, internet, coffee, snacks, TV, etc. while you wait. Or if you want a loaner, they'll make it happen too. Some even have shuttles that will drive you to the local mall.
Mind you, all of this would still be in place with a factory store, minus the hellish experience of buying a new vehicle.
Finally, while you're OK dropping the equivalent of a year's pay on a website, most people are not. They need to talk to someone. So you're still going to need salespeople ... although they'll be far more pleasant to deal with, since there will just be one price that everyone pays and you won't have to be in constant fear of being ripped off.