Why Doctors Reject Tools That Make Their Jobs Easier

Re:Why Doctors Reject Tools That Make Their Jobs Easier by cf498 on Monday October 15, 2018 @07:21PM (#18224963)

I think this is something that isnt that present in our profession as it should be. If you are an electrical engineer, it is clear and present, that your products might kill someone if you screw up. The same goes for a mechanical engineer. And it will be your responsibility. If you screw up and should have known better, you might even go to jail for negligence.

We on the other hand have the Therac-25.

We claim to be on a level of engineering fields. We should also act that way.

[ Parent | on HN ]

Re:Why Doctors Reject Tools That Make Their Jobs Easier by Balgair on Monday October 15, 2018 @07:29PM (#18225028)

Agreed. The Order of the Engineer is a good place to start and bringing that tradition down into comp-eng/sci would be a nice start.

https://en.wikipedia.org/wiki/Order_of_the_Engineer

[ Parent | on HN ]

Re:Why Doctors Reject Tools That Make Their Jobs Easier by Latteland on Tuesday October 16, 2018 @12:15AM (#18226452)

Interesting, had not heard of that. What should we computer programmers, we flexible always trying new things without enough tried and true practices think of real engineers, what should they think of us?

[ Parent | on HN ]

Re:Why Doctors Reject Tools That Make Their Jobs Easier by ionised on Tuesday October 16, 2018 @05:51AM (#18228025)

Real engineers should probably look down on us from a great height.

[ Parent | on HN ]

Re:Why Doctors Reject Tools That Make Their Jobs Easier by Balgair on Tuesday October 16, 2018 @11:09AM (#18229996)

Here's a more humorous take: https://imgs.xkcd.com/comics/voting_software.png

[ Parent | on HN ]

Re:Why Doctors Reject Tools That Make Their Jobs Easier by Someone on Monday October 15, 2018 @07:43PM (#18225122)

Therac-25 was thirty years ago, and still is the go to example. That made me wonder. If you compare, for example, https://en.wikipedia.org/wiki/List_of_bridge_failures#2000–p... or https://en.wikipedia.org/wiki/List_of_structural_failures_an... with https://en.wikipedia.org/wiki/List_of_software_bugs, software doesn’t look that deadly.

[ Parent | on HN ]

Re:Why Doctors Reject Tools That Make Their Jobs Easier by jcranmer on Monday October 15, 2018 @11:09PM (#18226084)

People generally don't attribute failures to software bugs if there is anything else that contributes to failure. The list in particular is missing the loads of accidents caused by bad UI; incidents of "I was just following the GPS's/autopilot's directions" that result in death are missing (such as the KAL 007 airliner incident).

[ Parent | on HN ]

Re:Why Doctors Reject Tools That Make Their Jobs Easier by tremon on Tuesday October 16, 2018 @07:34AM (#18228433)

The Therac-25 is the go-to example because it is the best documented and least-contested case. Also, software usually isn't in ultimate control, most systems have additional (mechanical) safety controls.

Mars Climate Orbiter, 1999: http://articles.latimes.com/1999/oct/01/news/mn-17288. Undetected metric conversion error (though unclear if this was a manual process or software).

Toyota unintended acceleration, 2010: https://www.edmunds.com/car-safety/for-toyota-owners-uninten.... Toyota maintains that it was not caused by software error.

Now let's list some cases where the software did have ultimate control:

Schiaparelli EDM lander, 2016: https://newatlas.com/esa-schiaparelli-mars-crash-inquiry/496.... Faulty decision-making in the automated descent system due to input saturation.

Tesla auto-pilot crash, 2016: https://www.theguardian.com/technology/2016/jun/30/tesla-aut.... Faulty decision-making due to incorrect image analysis. In this case, the additional safety controls (the driver himself) failed too.

Uber car crash, 2018: https://money.cnn.com/2018/03/20/news/companies/self-driving.... Faulty decision-making due to incorrect image analysis, though the investigation is still ongoing, so no definite cause determined (FAFAIK).

[ Parent | on HN ]

Re:Why Doctors Reject Tools That Make Their Jobs Easier by gruturo on Tuesday October 16, 2018 @04:16AM (#18227610)

Software doesn't have many opportunities to be deadly, and when said opportunities do exist, this is frequently in regulated fields where safeties are mandated by law (interlocks on a laser or a welding robot arm etc).

[ Parent | on HN ]

Re:Why Doctors Reject Tools That Make Their Jobs Easier by cgdcraig on Monday October 15, 2018 @11:22PM (#18226153)

I'd imagine a lot of places where software is part of a safety critical system also come with physical fail safes. An example being burst plates on pressure vessels, if the software that controls pressurization spasms and causes an over pressure the physical fail safe will prevent a catastrophic accident.

[ Parent | on HN ]

Re:Why Doctors Reject Tools That Make Their Jobs Easier by conanbatt on Tuesday October 16, 2018 @01:15AM (#18226734)

Software engineering is more like witch-doctoring than to civil engineering. It is not remotely price-efficient to prove completeness on programs.

If you expect your doctor's software to be perfect, be prepared to pay for 2 software engineers salaries per doctor.

[ Parent | on HN ]

Re:Why Doctors Reject Tools That Make Their Jobs Easier by pimmen on Tuesday October 16, 2018 @06:45AM (#18228203)

I agree that we act recklessly sometimes, but I hope I'm not alone among software engineers in believing that this finding from the committee was just plain stupidity which should not be done by any engineer worth his or her salt:

"AECL had never tested the Therac-25 with the combination of software and hardware until it was assembled at the hospital."

[ Parent | on HN ]