Re:Ask HN: Boring but important tech no one is working on?
by Fizzz on Friday August 26, 2022 @07:15PM
(#32613835)
How do you currently extract info from the FOIA request pages? What kind of info do you look for? Just thinking how you could standardise this
[ Parent
| on HN ]
Re:Ask HN: Boring but important tech no one is working on?
by chaps on Friday August 26, 2022 @11:17PM
(#32615291)
Mostly tesseract, or uploading it through documentcloud and running manual searches. I do a combination of data analysis and spend many hours reading through documents. Sometimes I use unix tools like grep/awk/etc, sometimes I use SQL. If the PDF isn't scanned, I use tabula for csv extraction, but if it's scanned it becomes a silly ordeal.
Mind you, I'm not exactly looking for advice here. It's a supremely difficult problem and gut-ideas more often than not don't pan out.