News for hackers. Stuff that matters.
Re:Takedowns run amok? The strange Secret Service/GoDaddy as... by cypherpunks01 on Thursday February 16, 2012 @09:56PM (#3601886)
IMHO this isn't a good task for the Turks. If it's reasonable that a Turk might click 'Looks good to me!' most of the time, you'll gather a hoard of them that just click/script that same response 100% of the time and not look at the question.

Of course you can include decoy questions to try and detect this behavior, but I just don't see the whole MTurk review process being terribly reliable overall. I just don't think the worker quality is that great, and they will do whatever possible to just churn through HITs (because they get paid zero for them).

Re:Takedowns run amok? The strange Secret Service/GoDaddy as... by hessenwolf on Friday February 17, 2012 @04:45AM (#3602783)
Can't this be solved with different Turks reviewing the same form on occasion as quality control?