News for hackers. Stuff that matters.
Re:Complex Car Software Becomes the Weak Spot Under the Hood by radiorental on Monday September 28, 2015 @11:33AM (#10290965)
"One option for making auto software safer is to open it to public scrutiny. While this might sound counterintuitive, some experts say that if automakers were forced to open up their source code, many interested people — including coding experts and academics — could search for bugs and vulnerabilities. "

This is simply not going to happen.

Firstly, the majority of automotive control systems on an ECU are running generated code from toolschains such as CATIA Systems, Dymola, MapleSim, OpenModelica, SCICOS, SimulationX, Vertex etc etc etc.

To validate against vulnerabilities requires in-depth knowledge of a particular manufacturer's modeling practices & standards. The code is not readable, the model is.

Which relates to the second reason, the IP in these models is very closely guarded. Competitive advantage and product differentiations are pretty much all software now. Even suppliers and manufacturers share black box models & systems back and forth for fear of leaking IP.

In a world where say BMW hands Bosch a set of requirement, Bosch supplies BMW HW and BMW validates in simulation and analysis with neither getting insight in to the other's design. You're telling that needs to now be done in the open?

Re:Complex Car Software Becomes the Weak Spot Under the Hood by ejdyksen on Monday September 28, 2015 @11:50AM (#10291050)
Well, what you're saying is that they wouldn't open source it voluntarily. This is why we have regulations: to make people and companies do things that they wouldn't do voluntarily.
Re:Complex Car Software Becomes the Weak Spot Under the Hood by radiorental on Monday September 28, 2015 @12:06PM (#10291132)
But isn't this analogous to asking Microsoft to open source their OS because of vulnerabilities.

I do not disagree with you. These are safety critical systems, I just don't see how companies could be forced to share IP.

What is more likely in my view is something similar to the validation standards in aviation: https://en.wikipedia.org/wiki/DO-178B

Re:Complex Car Software Becomes the Weak Spot Under the Hood by CWood1 on Monday September 28, 2015 @01:37PM (#10291742)
This raises a point that has confused me for a long time. Aerospace engineering is known for its track record of safety (not to say incidents don't happen, but they're rare, and usually self-contained). Why, then, is the same level of rigor not applied to the automotive industry, by government (or even international) mandate? Just as much damange can just as easily be done, and if it was possible to seize control of a Boeing 747 from your living room, you can bet there would be people fired within the hour, and arrested within the day.

That said, something tells me that, in light of recent events, there will be a push for the automotive industry to start using things like DO-178, and its companions for mechanical and electronic engineering (whose numbers I don't recall).

Re:Complex Car Software Becomes the Weak Spot Under the Hood by raisedbyninjas on Monday September 28, 2015 @03:46PM (#10292689)
Air travel is inherently more dangerous than automobile travel. This is intuitively and actually true. People learn from a very young age that falling hurts and falling even 10 meters can be fatal. Falling, flying, great heights tickle the fear centers in your lizard brain. Vehicles are more like incremental improvements to things that are safe like running or riding a horse. Additionally auto accidents are mostly isolated to 2 parties on the roadway they're travelling. So we don't exercise the same caution with cars.

Practically, air travel is safer because they are built, maintained, piloted, and continuously monitored by professionals. Conversely a 15 year old can build a kit car and drive it on the highway legally. If they break a dozen traffic laws they may or may not get caught and penalized.

If we could get people to assess and respond to risk rationally, we could make a lot of things safer.

Re:Complex Car Software Becomes the Weak Spot Under the Hood by ScottBurson on Monday September 28, 2015 @03:51PM (#10292718)
The psychology of it is interesting, isn't it? Flying in a plane seems so intuitively unsafe that we go to great efforts to make it safe, while traveling on the ground seems so intuitively safe that we don't worry about it as much. (Remember how hard it was to get most people to wear seat belts?) And yet, far more people die in car crashes than plane crashes.
Re:Complex Car Software Becomes the Weak Spot Under the Hood by msandford on Monday September 28, 2015 @12:10PM (#10291167)
Yes it is. And if hundreds or thousands of people had died from windows vulnerabilities and tremendous environmental damage had been done, that might well have happened.

Most of the security breaches are due to people doing stuff really wrong not just a late patch. And even then I haven't heard of anyone dying as a result yet.

People have probably died (if you believe public health stats) as a result of increased NOx production of these vehicles. There's also been a lot more pollution. Big, big pollution problems have caused substantial changes to things, like the creation of the EPA here in the US.

Re:Complex Car Software Becomes the Weak Spot Under the Hood by gambiting on Monday September 28, 2015 @12:12PM (#10291172)
>>if hundreds or thousands of people had died from windows vulnerabilities and tremendous environmental damage had been done

Then people would stop using Windows, simple as that.

Re:Complex Car Software Becomes the Weak Spot Under the Hood by nmrm2 on Monday September 28, 2015 @12:23PM (#10291247)
Just like people stop mining for coal or iron when it causes loss of life and environmental damage?

The people being harmed by software vulnerabilities are rarely the people who made an informed decision to use a certain piece of software. People who shop at Target can't meaningfully be said to make a choice to trust Target's software -- it's not something the average consumer things about.

So although "should" is an understandable prescription, "would" is a bit unrealistic...

Re:Complex Car Software Becomes the Weak Spot Under the Hood by gambiting on Monday September 28, 2015 @12:34PM (#10291312)
If there were any alternatives to coal or iron that wouldn't cause as large loss of life, then we would have switched to those. If you find out your car is unsafe to use, you switch to a different one, because other cars offer similar functionality - the same with Windows, if it was so full of bugs that it was an actual danger to use, then people would simply switch to Linux,*BSD or MacOS, it's not like there are no alternatives.
Re:Complex Car Software Becomes the Weak Spot Under the Hood by nmrm2 on Monday September 28, 2015 @01:10PM (#10291543)
The behavior you're describing is disproved by history. People use demonstrably insecure products that are insecure all the time, even when great secure alternatives exist.

Even speaking theoretically, the behavior you're describing isn't even an accurate description of how rational actors without resource constraints and with perfect knowledge would behave (because e.g. there are qualities aside from security and safety that might make it impossible to use an alternative product, and there might be qualities that are impossible to measure directly). And anyways, all three of those assumptions are clearly out-of-touch with reality.

Specifically wrt automobile software:

* Even with public access to source code, it's impossibly expensive for the average consumer (even the average software engineer; hell, even the average automotive engineer) to make a decision with truly perfect knowledge. Any number of safety constraints boil down to intractable questions if code is designed in a way that isn't amenable to inspection. So even in a purely theoretical setting with completely rational actors, making a fully informed decision might just not be possible.

* Many consumers will overlook errors in previous products and plausible errors in current products; Toyota's brand is doing just fine despite the findings of experts in the UA case. And I bet a lot of the software on cars that have sold even this year has some of the same structural problems, because based upon the expert testimony, a lot of that code probably needed to be essentially rewritten, and it's highly unlikely that they've achieved that in a year or two.

Re:Complex Car Software Becomes the Weak Spot Under the Hood by ethbro on Monday September 28, 2015 @05:15PM (#10293259)
The difference, to play da, is that both of your points get solved with greater transparency.

Is Linux more secure because everyone (quiet, Gentoo crowd) audits their own source? No, it's more secure because:

Anyone can choose to audit the source with minimal roadblocks.

Anyone who thinks they've found an issue can trumpet it from the rooftops.

Together, this means that even though I might not line-by-line audit my system, I can (with varying levels of paranoia / assurance) obtain a system that I have confidence others have audited. And furthermore, if there are issues found in the future then I can be reasonably sure of hearing about them.

Neither of these benefits is possible with closed source embedded systems.

(Or, from article "Ninety-nine percent of the buyers would never read anything. But out of the 11 million people whose car was cheating, one of them would have found it,” he said. “And Volkswagen would have been caught in 2009, not 2015.”)

Re:Complex Car Software Becomes the Weak Spot Under the Hood by nmrm2 on Monday September 28, 2015 @06:32PM (#10293642)
> both of your points get solved with greater transparency

My first point was exactly that transparency isn't a solution, even theoretically. There's no such thing as perfect knowledge when the questions you're asking are undecidable.

My second point was that even if transparency is a solution theoretically, it's demonstrably not a solution historically. People (including customers not subject to CYA-induced stupidity) choose insecure proprietary systems over secure open source systems all the time.

Re:Complex Car Software Becomes the Weak Spot Under the Hood by ocschwar on Monday September 28, 2015 @02:05PM (#10291928)
While Microsoft's product issues do impose externalities on net users at large, that pales in comparison to letting 2 ton machines travel 60 MPH on the roads, while running closed source software.

Simply require source code publication for cars that are to be made street legal.

Re:Complex Car Software Becomes the Weak Spot Under the Hood by Zigurd on Monday September 28, 2015 @12:09PM (#10291154)
There are a lot of bad reasons for "closely guarded" IP:

1. The government told you to put spyware in e.g. your mobile baseband processor

2. Your GPU violates a lot of patents

3. You ECU implements dark patterns w.r.t. emissions testing

Make regulations requiring publishing the code, and require making the toolchain available to code can be verified vs. the shipped image. Proprietary software isn't a valid excuse when the stakes are to poison the environment.

Re:Complex Car Software Becomes the Weak Spot Under the Hood by msandford on Monday September 28, 2015 @11:51AM (#10291052)
> This is simply not going to happen.

It's not going to happen unless legislated. That's the whole point. Currently there is no legislation forcing it to happen, but in the future there might be. That might be a good idea, even if the various companies involved don't want to do it.

Re:Complex Car Software Becomes the Weak Spot Under the Hood by nmrm2 on Monday September 28, 2015 @12:26PM (#10291269)
I agree with you -- the push for opening up code to public scrutiny is politically and economically unfeasible. But that doesn't mean nothing can be done -- a more palatable regulatory regime might require oversight a la the aerospace industry, but emphasizing the use of formal methods over expensive and arbitrary process hoop-jumping.
Re:Complex Car Software Becomes the Weak Spot Under the Hood by radiorental on Monday September 28, 2015 @01:05PM (#10291506)
Agreed, here's what aerospace arrived at (organically too) https://en.wikipedia.org/wiki/DO-178B
Re:Complex Car Software Becomes the Weak Spot Under the Hood by kaftoy on Monday September 28, 2015 @05:22PM (#10293297)
No problem for that. Are you ready to pay to have that? Because stuff like that does not come cheap. Quite sure we can find some numbers on the Internet, probably you are not the first people in the world to think of implementing aerospace regulation in the automotive business :-). I am pretty sure in an industry where saving 12$ / unit (trough some improvement for example) is considered a GIGANTIC gain, applying some super strict aerospace standards will take the car prices to unacceptable levels.
Re:Complex Car Software Becomes the Weak Spot Under the Hood by nmrm2 on Monday September 28, 2015 @06:21PM (#10293600)
Okay, then car companies can open source their ECU (and other safety-critical) software.

No one is recommending copy/pasting aerospace regulations. In part because we're now 10-30 years further along in basic and applied CS research than we were when those regs were drafted.

What makes aerospace regulations expensive is the process, not the analysis. The attitude that formal methods are completely untenable is painfully sutck in the 1990's. For god's sake, Facebook runs portions of their code base through static analyses, as does Google. If websites are important enough to establish the safety of using formal methods, then the software running are ours sure as hell is.

In any case, thing is sure: as software becomes an integral part of high-level safety-critical control decisions, it needs to either be taken seriously by car companies and trusted by the general public.

Formal methods and static analysis are the only way we know of for establishing trust in software systems without revealing their source code or relying on black box testing (the downsides of which are demonstrated by both the Toyota UA and VW emissions testing cases). If you know of a third option, then by all means...

Re:Complex Car Software Becomes the Weak Spot Under the Hood by kaftoy on Tuesday September 29, 2015 @02:14PM (#10298311)
True, maybe a little bit more openness would not hurt nobody. Probably would help people trust automakers more and not go nuts when a scandal goes live like the VW. Never seen any banks open their strategy to the public after so many of them fucked us over a few years ago. It's not like I can copy their strategy and go make me another bank.

But going back to automotive, because that's what I do for a living. The process is quite strict and controlled. Efforts is done and periodic audit is done too to ensure adherence to ASPICE (http://vda-qmc.de/en/software-processes/automotive-spice/) and other regulations, including customer audits, which are tough. We do have internal processes, coding (and not only) methods, source control, configuration management (features, bug tracking) across all project and generic development base.

The basic workflow is follows a V-cycle path:

- receive requirements.

- requirements engineering, experts involved;

- test design based on requirements;

- internal design of whatever kind (models etc.);

- design reviews, simulations (if models), all kind of analysis;

- implementation (if not code generation);

- code reviews;

- static analysis ((pc-)lint, klocwork to name a few);

- module tests (unitary tests (ptu), tests on the HW with simulated signals - aka tetsbench tests);

- integration tests;

- system validation tests (requirements tests), hardware-in-the-loop tests, close loop tests;

- dependability tests run on the car.

In parallel the system is calibrated and calibrations are used during validations. For every version going into production (because some are just interim steps for validation purpose), there's a lot of testing going on on features already tested before.

SW execution is monitored by SW. The micro is monitored in some interesting ways and on top of that an IC is monitoring all the... other monitors. Lots of stuff is done to ensure RAM/ROM consistency, process execution monitoring, signal acquisition plausibility. Many inputs/executions diagnostics are requested by the laws, but a lot more are done for system robustness. Not gonna talk about HW design and validations. They have their own set of regulations and standard tests to fulfill, which I don't know that good.

This is where the car maker takes over from the supplier and does their own set of tests (which I don't know in much detail): - tens/hundreds of thousands of miles on a fleet of vehicles, recording all that happens and future analysis follows - cold trip, hot trip plus various trips to test response to different altitudes, sea side effects etc. - lots of garage testing - regulations tests (the car must respect various regulations of the countries it targets... OBD regulations, CARB, EU stuff, etc.)

A lot of other tests are carried out in different phases of production. For example a special SW which runs on the production line is designed to test all circuitry one last time before flashing the real working SW.

Too many people have the impression this SW is build "on our knees" (an expression that sounds good in my native language), but this is far beyond that. The threat of car recalls (which is, in the end, charged to the supplier causing it, or the car maker if it is his fault) and fucking up all the profit is not stuff engineering plays with. There are over 1k engineers working on engine ECU R&D in various locations (from system design to SW and tests).