Edit: while the end result of both “steered into” and “failed to avoid” an obstacle are the same, the method is very different. If a car suddenly steers into an obstacle, an attentive driver might not be able to react quickly enough to avoid it, whereas driving straight into something the car fails to see is very unlikely with an attentive driver.
To have to fight the autopilot and correct the wrong decisions it sometimes makes is what makes it scarier than manual driving, since in the latter case you don't have to fight where the car goes --- unless the steering/suspension is defective or the road is very uneven, it will go in a straight line with no driver input.
So then what is the point of Autopilot at all? I'm a big fan of Tesla, and I've wanted to try Autopilot for years, but after I saw that YouTube video of the driver needing to slam on the breaks to barely avoid hitting the divider, I thought "no thanks". If Autopilot dangerously lulls you into a false sense of security, I'd rather drive manually where I'm forced to be attentive.
...which has a hard time being "fully attentive" when the car (mostly) drives itself. On the other hand, given the recent head-on-into-a-divider incident, I'd say using it has become worse than manually driving since you now have to correct it when it surprises you by suddenly steering into obstacles.