News for hackers. Stuff that matters.
Re:Search PDFs with Transformers and Python Notebook by rahimnathwani on Monday July 25, 2022 @10:22AM (#32224693)
Under the hood, it uses https://github.com/pdfminer/pdfminer.six which expects the text to be stored as text.
Re:Search PDFs with Transformers and Python Notebook by alexcg1 on Monday July 25, 2022 @10:28AM (#32224779)
You mean the PDFSegmenter Executor in the notebook?
Re:Search PDFs with Transformers and Python Notebook by rahimnathwani on Monday July 25, 2022 @10:33AM (#32224852)
Yes
Re:Search PDFs with Transformers and Python Notebook by alexcg1 on Monday July 25, 2022 @11:12AM (#32225494)
PDFSegmenter also extracts images, which can then be OCR'ed in the next step of the pipeline