News for hackers. Stuff that matters.
Re:What's so hard about PDF text extraction? by jrandm on Tuesday March 03, 2020 @08:39AM (#22474313)
> Finding an algorithm that approximates how a human approaches a page layout doesn’t feel like it would be all that hard.

"In CS, it can be hard to explain the difference between the easy and the virtually impossible."

https://xkcd.com/1425/

Re:What's so hard about PDF text extraction? by Wiretrip on Tuesday March 03, 2020 @08:59AM (#22474442)
Totally agree. I worked on a project that had to try and extract tables from PDFs. It is much harder that it would first appear.
Re:What's so hard about PDF text extraction? by ldenoue on Tuesday March 03, 2020 @09:34AM (#22474726)
Detecting where tables are is still an active research areas. Once we know where on the page, it’s easier to parse out their structure.
Re:What's so hard about PDF text extraction? by pqdfdsaff on Tuesday March 03, 2020 @09:24AM (#22474645)
To be fair, that particular comic's 5 year task was solved shortly after it was posted, at least in part to prove it was wrong.
Re:What's so hard about PDF text extraction? by gmiller123456 on Tuesday March 03, 2020 @02:44PM (#22478049)
Without having heard of or tested the solution, I'll bet anyone $1M that I can produce an image that produces an incorrect answer. Which would mean it's not "solved".
Re:What's so hard about PDF text extraction? by pqdfdsaff on Tuesday March 03, 2020 @02:54PM (#22478157)
If I can produce an image that you incorrectly label as Bird or No Bird, does that mean it's accurate to say you cannot tell me if pictures have birds in them? Or is that needlessly pedantic beyond any practical use case and clearly the intended context?
Re:What's so hard about PDF text extraction? by emodendroket on Tuesday March 03, 2020 @05:00PM (#22479124)
No, I don't think it's pedantic and impractical. There are many use cases where the possibility of adversarial input makes heuristics a non-starter.
Re:What's so hard about PDF text extraction? by pqdfdsaff on Tuesday March 03, 2020 @06:10PM (#22479625)
Please tell me the practical concerns regarding adversarial inputs against a phone app that tries to tag pictures of birds in national parks.
Re:What's so hard about PDF text extraction? by emodendroket on Thursday March 05, 2020 @10:12AM (#22494129)
Well of course if you define it narrowly that's true, but computer vision has many more safety-critical applications, most obviously self-driving.
Re:What's so hard about PDF text extraction? by gmiller123456 on Wednesday March 04, 2020 @01:27PM (#22486322)
"Doing better than me", or any other human, wasn't the problem proposed. Anything other than 100% accuracy means the problem isn't solved as there will always be room for a better solution.
Re:What's so hard about PDF text extraction? by pqdfdsaff on Wednesday March 04, 2020 @02:28PM (#22487062)
The problem posed was "can my app tag photos with birds". The answer is now yes for all practical purposes.

You italicized the word 'solved' to emphasize that under technical scrutiny it is not true in response to a claim about being pedantic.

100% accuracy on identifying birds is, epistemologically, impossible.