News for hackers. Stuff that matters.
Re:UK scientists ask for help in transcribing 200 years of r... by scrollaway on Friday March 27, 2020 @01:11AM (#22700573)
What accuracy do you think humans have?

If I give you 1000 handwritten numbers, do you think you'll make less than 10 mistakes?

Re:UK scientists ask for help in transcribing 200 years of r... by astrobe_ on Friday March 27, 2020 @03:59AM (#22701095)
The forms are in open access, anyone can fill one form, so they surely did consider variations in accuracy (if not plain sabotage). They are probably submitting the same data to multiple people and the cross-checking the submissions. Also, the totals help to filter out submissions with mistakes. One can also add bound checking for individual values (misplaced decimal point, extra digits etc.). I would love to see how they do it, but they'll probably keep it confidential because trolls and other vandals.
Re:UK scientists ask for help in transcribing 200 years of r... by reportingsjr on Friday March 27, 2020 @12:12PM (#22704136)
This is exactly how zooniverse works. The first thing you do is go through a few known pieces of data to verify you know how to identify things correctly (more important for galaxy types, etc).

As you start labeling data everything has to reach a consensus. I'm not sure exactly how it works, but it does have multiple people verify each piece of data.

Re:UK scientists ask for help in transcribing 200 years of r... by Arbalest on Friday March 27, 2020 @01:44AM (#22700663)
Run both OCR and human in parallel and double check anomalies
Re:UK scientists ask for help in transcribing 200 years of r... by saagarjha on Friday March 27, 2020 @03:52AM (#22701065)
I would expect humans to make similar errors.
Re:UK scientists ask for help in transcribing 200 years of r... by Arnt on Friday March 27, 2020 @04:48AM (#22701279)
AIUI the classic procedure for tasks like this is/was:

Hide some graduate students. Tell each to transcribe, and to mark the difficult spots. Give each page to two students. Next, have someone else process the page pairs and resolve conflicts and the marked trouble spots.

As long as one of the students notices that a particular spot is difficult to read, the error is discovered and can be handled by someone who isn't numb from transcribing pages of simple numbers.

Re:UK scientists ask for help in transcribing 200 years of r... by deepnet on Friday March 27, 2020 @01:41AM (#22700661)
They will likely assign the same tasks to multiple people and use an ensemble of human consensus.