News for hackers. Stuff that matters.
Re:Moral Machine by hexane360 on Monday October 03, 2016 @11:33PM (#12633148)
I think part of their intent was to show biases in judgement. The small sample size really hindered this though. Apparently I 100% preferred old people to young people, even though I didn't consider age in my decisions at all.

They do have a little disclaimer on the results screen about the sample size though.

Re:Moral Machine by macawfish on Tuesday October 04, 2016 @12:16AM (#12633308)
The bias is generated by the lack of real choice in responses. They are offering an unrepresentative range of choices, then going and telling you that your choices are biased. They're not showing existing bias, they're coercing it out of participants.

This thing irritated me so bad that I couldn't bring myself to answer a single question. I can't stand the idea that my this study is actually happening. If the results are published and receive non-critical media attention, I'm gonna be irate.

Re:Moral Machine by esfandia on Tuesday October 04, 2016 @03:04AM (#12633778)
But then you'd need to answer 100 or more test questions instead of 13. This is necessarily simplistic given how much involvement they can ask of participants.

Also, I don't think they're implying anything nefarious about the resulting biases shown in the final results. For sure a lot of it has to do with the small sample size of the questions. I didn't run the tests twice, but I imagine there is some randomness involved in the way they are generated.

If there are any heuristics at play, the results will indeed show them (in my case there were enough tests to recover the fact that I preferred saving passengers, preferred non-intervention, and preferred saving humans over pets). But it will also come up with some gibberish/noise due to the small sample size.

Re:Moral Machine by JoshTriplett on Tuesday October 04, 2016 @03:10AM (#12633803)
> But then you'd need to answer 100 or more test questions instead of 13.

Or they could design questions designed to more definitively separate different hypotheses in fewer questions.

Re:Moral Machine by macawfish on Tuesday October 04, 2016 @03:21AM (#12633851)
It doesn't matter how big the sample size is if the questions themselves are biased.
Re:Moral Machine by fela on Tuesday October 04, 2016 @03:29AM (#12633879)
On a single participant yes, but their real goal, I presume, is to aggregate the data and then they will be able to reach more concrete conclusions.