I'd say yes. The goal of a self-driving car is to emulate humans. If the car is panicking and reverting to "extreme safety mode" in situations where a normal human is going to be fine, then that's a failure.