Re:Why does software cost so much?
by strong_silent_t on Wednesday April 18, 2018 @01:03PM
(#16868979)
It does look like a really interesting avenue of research. I see a lot of statistical "evidence" presented as justifying interventions without even hesitating to consider if they've got it the wrong way around in terms of causality.
It seems it will be focused on large scale products out of necessity because of the availability of structured data and public disclosure.
There is one preliminary paper linked in the article, which I haven't read: https://dl.acm.org/citation.cfm?id=3172876
It is really interesting to see ways to establish causality without a randomized controlled trial, since in a lot of circumstances an RCT is impossible or unethical, and because for many decision making purposes you need to evaluate interventions, not just relationships.
Re:Why does software cost so much?
by dredmorbius on Wednesday April 18, 2018 @01:16PM
(#16869078)
Alternative: https://outline.com/EV6FPg
http://archive.is/https://insights.sei.cmu.edu/sei_blog/2018...
Internet Archive doesn't yet have the page, though eventually it should show here: https://web.archive.org/web/*/https://insights.sei.cmu.edu/s...
>> "If we want to proactively control outcomes, we would be far more effective if we knew which organizational, program, training, process, tool, and personnel factors actually caused the outcomes we care about. To know this information with any certainty, we must move beyond correlation and regression to the subject of causation. We also want to establish causation without the expense and challenge of conducting controlled experiments, the traditional approach to learning about causation within a domain. Establishing causation with observational data remains a vital need and a key technical challenge."
>> "Armed with this new approach, we are exploring causal factors driving software cost within DoD programs and systems. For example, vendor tools might identify anywhere between 25 and 45 inputs that are used to estimate software development. We believe that the great majority of these factors are not causal and thus distract program managers from identifying factors that should be controlled."
Since down, didn't read: Don't assume you know the answer. The point of the research is to prove what's actually a causal driver of costs, not just an unrelated correlation winking suggestively at it.