I'm pretty sure anyone sane realizes that the current production shipping autopilot hardware is not capable of fully autonomous driving ie: 100% humanless. I also think that no one is handwaving anything as it is a problem that as of yet, has never been solved. However, data is an enabler for this and having more of it means Tesla is uniquely positioned to crack that nut before anyone else. Teslas are collecting data even when AP isn't enabled. That doesn't mean the cameras are off or the radar is off (they aren't). This simple fact gives Tesla a leg up over virtually all of the competition and until Uber has the same or superior tech on all of the uber fleet, they'll be lagging.
So... When the tech is capable of full autonomy, Tesla will be sitting on an absolute treasure trove of fleet data, which they'll be able to exploit.
Human drivers have actively-pointed stereo vision sensors, IMU, and haptic feedback from the steering wheel and pedals. That's it. We know it can be done with only those sensors.
I think people are handwaving away the true difficulty of door-to-door (as opposed to lane-keeping) driver-less cars that can operate safely without humans being attentive all the time.