I have three giant knobs inches away from my gear lever to control the climate. Climate control status is on a screen just below line of sight to the road.
I'm moving my hand a few inches and generally not even needing to look at anything to get feedback (I can set the fan speed by ear...), and if I do I can do it without taking my eyes off of the road.
I'm controlling the climate control for my comfort, not to hit arbitrary numbers. If I make a quick stop and spend a few minutes out in 110 degree heat, I wanna get in and have ice cold air blasting in my face until I'm comfortable. I don't care if the car is already a chilly 66f inside. If it's -40 outside, I want it to blow heat directly on my feet when I get in until my toes warm up even if the car is already warm. Hell, sometimes if it's too warm in there and my toes are frozen I'll drive around with the heat blasting and a window cracked to keep it comfortable.
I shouldn't need to sacrifice my comfort so the manufacturers can continue building shitty and dangerous UIs for basic vehicle functions.
So we should probably focus on making things people need to do in their car as quick and intuitive as possible to limit the distraction.
We put radio controls on the steering wheel to make it easier and safer to do things like adjust the volume. We don't just tell people "set your volume before you get moving and let the speed dependent volume control take over from there".
Climate control is a great feature. But it's not perfect, and there are instances where you need to manually override. Just because you don't run into them doesn't mean they don't exist.
EDIT: BTW on cars with physical controls all of these things are either button press or dial turn away. I've never had to look at the controls to do these things.
Setting my car to 70F inside instead of it's current 72F won't make it cool any faster. Even setting it to it's "LO" setting won't make it cool any faster. The AC compressor is either on or off. The car will set the fan speed to it's best possible speed to cool the car as fast as it can regardless of it being 72 or 70 or 68. Me adjusting things manually won't make the compressor work harder or make the car cool faster.
There's zero benefit for me to touch the AC controls. The car knows it's hot. The car knows how I want it. It will do what it can to get it to that target temp. Me doing anything will just result in more distraction away from actually driving the car.
But more practically, if I start catching a lot of sun from the window I might want to go from 72 to 70 to compensate, even if the cabin temperature is more or less the same.
I live in Texas. I assure you I live in an area with high heat and intense sun. My cars have glass roofs. My cars seem to handle it fine.
That blazing sun shining on you via radiation directly feels different than if the sky is overcast.
I want to easily tweak the temp to account for my personal comfort. I don't care about the temp of the air except as an input to helping me be comfortable.
I don't want to have to start and then sit in my car idling to wait until it gets to temp only to find out I want a little more or less.
On top of that, my cars also know how intense the sun is. It wouldn't surprise me if that's also an input to the climate control.