News for hackers. Stuff that matters.
Re:Mechanical Turk vs oDesk by 83457 on Sunday February 19, 2012 @09:44AM (#3609442)
Good idea. I've also thought about this for data entry/analysis type tasks. It is fully expected that a worker on any level won't be perfect, especially on these types of services. An approach I've considered is to have have 3 workers do the same task then compare results and take the majority answer which should be close to if not 100% accurate. Overtime you could even rate workers for accuracy and recruit/pay more if possible.
Re:Mechanical Turk vs oDesk by Panos on Sunday February 19, 2012 @10:19AM (#3609501)
On a very selfish note, take a look at these:

http://qmturk.appspot.com/ http://code.google.com/p/get-another-label/

You may find the code useful for what you are trying to do.