There's a video of someone reproducing this (and not crashing) on YouTube --- he managed to stop the car in time, but still came awfully close to the divider, and this is someone who was likely paying a lot more attention at the time than the typical autopilot user.

To have to fight the autopilot and correct the wrong decisions it sometimes makes is what makes it scarier than manual driving, since in the latter case you don't have to fight where the car goes --- unless the steering/suspension is defective or the road is very uneven, it will go in a straight line with no driver input.