News for hackers. Stuff that matters.
Re:Ingesting PDFs and why Gemini 2.0 changes everything by sconeguy on Wednesday February 05, 2025 @06:27PM (#42956861)
What would it have taken to store the plain text in some meta field in the document. Argh, so annoying.
Re:Ingesting PDFs and why Gemini 2.0 changes everything by dkjaudyeqooe on Wednesday February 05, 2025 @07:59PM (#42957625)
PDF provide that capability, but editors don't produce it, probably because printing is though OS drivers that don't support it, or PDF generators that don't support it. Or they do support it but users don't know to check that option, or turn it off because it makes PDFs too large.
Re:Ingesting PDFs and why Gemini 2.0 changes everything by user_7832 on Wednesday February 05, 2025 @10:51PM (#42958861)
Do you know what this field/type is called, and I’d any of the big names (MS/Adobe etc) support creating such PDFs?
Re:Ingesting PDFs and why Gemini 2.0 changes everything by bux93 on Thursday February 06, 2025 @02:19AM (#42959942)
OCR software like ABBY can spit out something called a "searchable PDF", which has a text layer underneath a picture of a scan. Otherwise, PDF has 'dictionaries' with arbitrary key-value pairs in them. The "Info" dictionary has some specific metadata fields like Author, and a "Font" dictionary embeds fonts, but you're free to use those dictionaries for whatever. There's also a standard to embed 'dublin core', rights management and custom metadata called XMP. Files can be embedded. You can also use comments, as PDF is a subset of postscript. When a PDF gets converted to PDF/A (by archiving software) or flattened/optimized, most of these are likely to be lost.
Re:Ingesting PDFs and why Gemini 2.0 changes everything by dkjaudyeqooe on Thursday February 06, 2025 @04:31AM (#42960671)
I believe it's a "hybrid PDF" but I'm not sure if there's a further standard for merely embedding text.

https://stackoverflow.com/questions/67358370/what-the-standa...

Re:Ingesting PDFs and why Gemini 2.0 changes everything by groby_b on Wednesday February 05, 2025 @08:04PM (#42957655)
PDF supports that just fine. It's just that many PDF publishers choose not to use that.

You can lead a horse to water...