News for hackers. Stuff that matters.

A comment on The rise of 'pseudo-AI': how tech firms quietly use humans to do bots' work. Parent comment

Re:The rise of 'pseudo-AI': how tech firms quietly use human... by vultour on Sunday July 08, 2018 @08:50AM (#17483517)
How do they handle bogus results from MTurk? I know people that tried to use it and had to stop because 95% of the "workers" just put meaningless data in hoping you don't notice and they get paid.
[ Parent | on HN ]
Re:The rise of 'pseudo-AI': how tech firms quietly use human... by JimmyAustin on Sunday July 08, 2018 @09:11AM (#17483610)
It depends on the task, but if you can get them to do multiple tasks in one, you can ask them to do a task you already know the answer to. If they get the known answer wrong, instant reject.
[ Parent | on HN ]
Re:The rise of 'pseudo-AI': how tech firms quietly use human... by PretzelFisch on Sunday July 08, 2018 @09:22AM (#17483660)
Couldn't you just solve that by sending the job to multiple workers and comparing the results?
[ Parent | on HN ]
Re:The rise of 'pseudo-AI': how tech firms quietly use human... by vultour on Sunday July 08, 2018 @05:36PM (#17486344)
That's an obvious solution, but you might start approaching a point where it's actually cheaper to hire a dedicated person for it.
[ Parent | on HN ]
Re:The rise of 'pseudo-AI': how tech firms quietly use human... by srtjstjsj on Monday July 09, 2018 @03:50AM (#17488621)
That doesn't solve the problem of a person being wrong.
[ Parent | on HN ]
Re:The rise of 'pseudo-AI': how tech firms quietly use human... by shanghaiaway on Sunday July 08, 2018 @09:35AM (#17483713)
Think about it.
[ Parent | on HN ]