Re:Self-Driving Cars Must Meet 15 Benchmarks in U.S. Guidance
by DougWebb on Tuesday September 20, 2016 @11:01AM
(#12540029)
That sounds pretty much just like web application development, or any other front-end user-facing development. You can verify internal components through testing, but once you introduce non-deterministic random variables like browser software your user is using, and your user's themselves, all you can do is validate the entire system through real-world testing and hope you've covered the edge cases you need to handle and will fail gracefully for the ones you missed.
Re:Self-Driving Cars Must Meet 15 Benchmarks in U.S. Guidance
by seren on Tuesday September 20, 2016 @11:03AM
(#12540040)
The point I was trying to make is that if you have actuators running MISRA C that are going to be driven by something written in Tensorflow, does it still makes sense to have a requirement to use MISRA C in the first place for the low level part ?
Re:Self-Driving Cars Must Meet 15 Benchmarks in U.S. Guidance
by etendue on Tuesday September 20, 2016 @11:20AM
(#12540181)
I'd be very wary of using complex SOUP like TensorFlow, even if brought under my quality system. I think a good answer here is that once one goes under design control the subset of functionality needed should be implemented in-house under the organization's SDLC.
Re:Self-Driving Cars Must Meet 15 Benchmarks in U.S. Guidance
by ansgri on Tuesday September 20, 2016 @05:14PM
(#12543488)
Of course these things are meant to be used (1) to train the system, (2) as a player in the prototype. Exactly like in the old school ML-based systems: you train in Matlab or CudaConvNet, and then you load the trained classifier into the custom-made player highly tuned to your hardware and problem domain.
Re:Self-Driving Cars Must Meet 15 Benchmarks in U.S. Guidance
by Qworg on Tuesday September 20, 2016 @11:37AM
(#12540315)
Most certainly - safety should be guaranteed at the lowest level, even if Tensorflow gets borked.
Think of it as a failure cascade - if Tensorflow breaks, the car can safely stop. If the low level stuff breaks, the car may not be able to stop (or go).
Verify components, validate the entire system is the typical approach.