A broken traffic light seems no different than a 4 way stop once you've realised it's broken, and I'm pretty sure Waymo can handle those already.
In my experience it's not the same, unless it's stuck red all four directions, and all the drivers understand that.
In California most lights have sensors, and the sensors themselves can break/not be properly calibrated. When you happen across this that means is certain lights will always be green, and others will always be red.
It's mostly a problem with motorcycles, and I've had to go through my fair share of red lights late at night when no one was around, but I've also (rarely) had a problem with a car.
Driving through a red light when it's obvious something's gone wrong with the traffic signal, and it's stuck on red. Harder than it seems at first, because other drivers at the intersection seem to make up the rules interactively, with you, via facial expressions and hand waving.
There's also a fair amount of variables, like looking sideways to see if the cross traffic is also stuck on red or not.