Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl...
by generalizations on Sunday September 05, 2021 @11:25AM
(#28425020)
Seems like a large part of what's needed is just being able to make the pdfs machine-readable, by making decent plain-text versions of the text content. Right now, IIRC, there's no hands-off way to get the text of a pdf. Especially if there's weirdness like multiple-columns (sometimes happens with this stuff).
[ Parent
| on HN ]
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl...
by zapataband1 on Sunday September 05, 2021 @11:45AM
(#28425183)
Like you said the hard parts are the unstructured data/images/tables. There are pretty-good(80% of the way there) solutions tho. But nothing that could handle millions of paper without error
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl...
by zapataband1 on Sunday September 05, 2021 @11:44AM
(#28425176)
Currently working in this field and this is actually the cutting-edge(!!) but it will be 100% possible/robust within the next year or so I believe. Really cool ML techniques being used for htis.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl...
by sleepingsoul on Sunday September 05, 2021 @02:48PM
(#28426677)
How well does it work with old OCR'd PDFs? :)
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl...
by generalizations on Sunday September 05, 2021 @10:33PM
(#28429681)
I had no idea. Is there anything that's open source, or is it all still being kept proprietary?