News for hackers. Stuff that matters.
Re:Ask HN: Do you know a good resource for large data scrapi... by ig1 on Thursday February 09, 2012 @07:31PM (#3573915)
The typical way of doing this is to use mechanical turk, there are some third party services (their name escapes me) which are built on top of mturk to provide reliability.

The typical way they do this is to have two different people enter the data and when there's a mismatch have a supervisor decide which is right.

Re:Ask HN: Do you know a good resource for large data scrapi... by hugo31370 on Thursday February 09, 2012 @07:58PM (#3573994)
I've used mechanical turk in the past for easy tasks. This one requires a little learning and I feel people get a lot faster even after 1 day. My concern with Mturk is having different people all the time, which is a lot less efficient. To give you a number, right now it takes me 1-2 minutes to add a line, whereas for someone new it takes him 5-8 minutes. That's the kind of learning curve I'm hoping for if I hire the same person to do this for 2-3 weeks.

Do you know if Mturk can offer this? Thanks a lot!

Re:Ask HN: Do you know a good resource for large data scrapi... by ig1 on Friday February 10, 2012 @12:14PM (#3576552)
I believe you can create a custom group of qualified workers on mturk
Re:Ask HN: Do you know a good resource for large data scrapi... by hugo31370 on Monday February 13, 2012 @04:50AM (#3584923)
thanks