Lol. This is what I found extremely shocking and is the first thing that I noticed. I don't think anyone serious about embedded design would touch it. They are trying to ignore decades of experience in real time systems and build some hacky stuff and make it open source.

In reality the comma-AI isn't controlling the car, a number of peripherals on the canbus are controlling the car. All those peripherals are hard-real time, and the comma-AI is bridging the non-deterministic neural networks and those hard-real-time peripherals.

At some point you need to deal with the non-deterministic neural networks, and bridge them into a hard real-time control system. People complaining that part of the system isn't real-time just seems like they haven't thought about it very much. Of course the UI and neural networks aren't going to be hard real-time.

The neural net will never be late. It just might be inaccurate.

I'm still somewhat confused as to how multi-object recognition works in a real-time way, naively I'd presume that recognizing n+1 objects in a frame would take longer than n objects.

You might be able to more practically get real-time neural networks using something like YOLO (you only look once)?

Either way it seems to me like hard real-time neural networks are a very challenging problem.

I don't know that it's much different than using cruise-control and then having a serious crash. If there's criminal negligence when using cruise control, it's because you weren't aware-enough to shut it off when the conditions cruise-control is built for no longer applied; the mere fact of using cruise-control isn't criminally negligent, as long as you're "just waiting for it to slip up so you can take the wheel."

For that matter, the same is true of teaching a teenager to drive. There's no negligence to having them at the wheel if you're ready to supercede their bad driving at all times.

What's suddenly different, if the "thing that doesn't really know how to drive yet, but which you're ready to supercede the bad driving of" is an AI instead of a teenager?

If a serious crash involving comma.ai went to trial, it would look like the driver was using unapproved, unregulated software, unnecessarily, putting others at risk. Recent Autopilot incidents show us that expecting a human to take over within a second is not reasonable. I would be very worried that the court would indeed find the driver negligent.

I use open pilot on the highway, and I love it. I had to physically tap into the CAN bus for my car's safety system, that made me very nervous. But the installation is completely reversible, and I'm much more comfortable with it's limitations. I just treat it as a really great adaptive cruise control and active lane keep assist.

But that's all it is. I would be completely responsible in most situations if my car caused an accident while open pilot was active. Open pilot's design has it immediately drop all control of the car if you touch the brake or gas, it does not aggressively follow cars, and the driver is still required to control the car. So if I start to become uncomfortable I need to immediately take over.

Assuming that open pilot will always act within it's safety guidelines doesn't mean that its safe. Toyota's paid tens of millions in fines and settled multiple lawsuits over unintended acceleration. I believe that using openpilot on the highway means I'm a safer driver. But I do understand that if I did get in an accident proving I'm not negligent might be extremely difficult.

I agree with you, liability is a very important part of self driving functionality. I won't think a car has full self driving capability until I can get in the back of that car, go to sleep, have it drive me somewhere, and hold no legal or financial responsibility for any accidents that occur. Openpilot is nowhere close to that, but I do think it's really good for what it's meant to do.

https://www.youtube.com/watch?v=u-dgbrB7PZU

I like him, personally.

The Bully wins

Tesla trying to kill someone: https://www.youtube.com/watch?v=0GnysB0rO3s

The super reliable "Level 3" Audi system not being able to go straight on a highway, the most simple problem there is in self-driving: https://www.youtube.com/watch?v=WsiUwq_M8lE&t=297

Several cars "pedestrian safety system" failing on detecting pedestrian (You had one job..) https://www.youtube.com/watch?v=7Y8JG7kepwc

Let's be honest, there is not a single driving assistant that isn't dangerous. Why care for "realtime" if your model tries to kill you once per minute? Realtime is one of the final touches you need to make your software perfect. That's just how the industry works, and if you want to keep up with them you have to go the same route, or do you know of any exception? Most manufacturers tell you that you should closely watch what your car is doing on autopilot, and they limit it's torque and acceleration, so the human driver is reliability, redundancy, testing and the realtime system.

I use open pilot for highway driving and love it. But Comma AI is intentionally making design decisions to get around regulation.

This can't be true ... ?

And this time it's people what they're moving :P

https://news.ycombinator.com/item?id=12840368

https://techcrunch.com/2016/10/28/comma-ai-cancels-the-comma...

> Currently, openpilot performs the functions of Adaptive Cruise Control (ACC) and Automated Lane Centering (ALC) for compatible vehicles. It performs similarly to Tesla Autopilot and GM Super Cruise. openpilot can steer, accelerate, and brake automatically for other vehicles within its lane.

Notably, the NHTSA called out these exact features in their letter to Comma.ai: https://techcrunch.com/2016/10/28/comma-ai-cancels-the-comma...

Look at the directory structure for the software - it has a "selfdrive" directory where all the code is![2]

[1] https://venturebeat.com/2020/01/07/comma-ai-launches-comma-t...

[2] https://github.com/commaai/openpilot#directory-structure