News for hackers. Stuff that matters.
Re:UK scientists ask for help in transcribing 200 years of r... by ant6n on Friday March 27, 2020 @03:41AM (#22701038)
Is there a technology that would help ocr-ing standardized forms? I’ve got a couple thousand pages of historical train schedules that i would like to digitize (tabulated, printed data, including symbols/icons), but I’m not sure how to automatically recognize the structured data.
Re:UK scientists ask for help in transcribing 200 years of r... by jasoncabot on Friday March 27, 2020 @07:05AM (#22701875)
(disclaimer MS employee but nothing to do with this product)

You could check out the Azure Forms Recognizer. It's designed to do exactly this and make even training a custom model pretty easy. It's also pretty cheap (free up to 500 pages) so you can always do a quick experiment and see if it does what you need it to

https://docs.microsoft.com/en-us/azure/cognitive-services/fo...

Re:UK scientists ask for help in transcribing 200 years of r... by froindt on Friday March 27, 2020 @08:53AM (#22702453)
I'm curious, what's your interest in the train schedules?

One day at an antique shop, I came across a book from ~1910 which had hundreds of pages of annual reports from railroads with many metrics we'd expect to see in the 10-K reports public companies file.

The book was published annually, but had much of its data in tables with grouped headers and cells, which could make automated OCR-ing with a good (useful) end result challenging.

I think it'd be interesting to map out the Railroad consolidation, track all their financial metrics over time, and do some level of forensic accounting to see if/which companies probably had funny business going on.

Re:UK scientists ask for help in transcribing 200 years of r... by ant6n on Saturday March 28, 2020 @04:37AM (#22709957)
I’ve got European rail schedules, which gives an indication of historical travel patterns. Specifically looking into the development of overnight travel.
Re:UK scientists ask for help in transcribing 200 years of r... by GijsjanB on Friday March 27, 2020 @05:13AM (#22701351)
I don't know about out-of-the-box ready software. Depending on how much time you have you'd either train your own model with your own ground truth or you can use an open source model. Libraries and archives sometimes make theirs available (I know the Dutch National Archives do). You can train the model and/or HTR the data with software like Transcribus or Kraken (open source).
Re:UK scientists ask for help in transcribing 200 years of r... by martyvis on Friday March 27, 2020 @07:19AM (#22701951)
I remember getting some reference software and methods from NIST maybe 20 years ago on handwriting recognition. Never put it into practice, but maybe they have some updated software available