News for hackers. Stuff that matters.
Re:Embedded PDF viewer in Firefox 81 supports filling forms by Someone on Tuesday September 22, 2020 @12:05PM (#24556170)
OK, they added various ways of data compression, but PDF is, basically, a text-based format.

As far as I know, any PDF can be losslessly converted to an equivalent PDF that can be edited in any text editor, even Notepad. And yes, you could fill in the forms there, too (if you were stubborn enough)

Re:Embedded PDF viewer in Firefox 81 supports filling forms by roflc0ptic on Tuesday September 22, 2020 @12:15PM (#24556304)
It sounds like you either know a lot more than me or a lot less than me. The PDFs I've dealt with don't store text as strings, they store it as individual characters. This left me having to write a heuristic based algorithm to group the characters into words, words into lines, lines into paragraphs, paragraphs into columns.

Again, as far as I know, there are no heuristics good enough to get that right for all values of PDF.

Re:Embedded PDF viewer in Firefox 81 supports filling forms by belval on Tuesday September 22, 2020 @12:24PM (#24556438)
He knows a lot less than you probably because there is absolutely no requirements for PDFs to be in text format and most aren't. The "text" he is editing could render to completely different characters depending on how the PDF document was created.

The default MacOS PDF printer will actually remap the font cmap making born-digital PDFs where the "text" is something else entirely (say "$" maps to "a").

Re:Embedded PDF viewer in Firefox 81 supports filling forms by yjftsjthsd-h on Tuesday September 22, 2020 @03:39PM (#24558888)
> The default MacOS PDF printer will actually remap the font cmap making born-digital PDFs where the "text" is something else entirely (say "$" maps to "a").

What? Why!? I've heard of doing that as a form of DRM, but I can't imagine Darwin defaulting to doing that.

Re:Embedded PDF viewer in Firefox 81 supports filling forms by belval on Tuesday September 22, 2020 @04:18PM (#24559349)
I never dug deeper into it, so I am not aware of why it does that or if it's a specific version or whatnot, but take a PDF from which you can extract the text (with pdftotext/pdfbox for example). Open it in the document viewer and "print" it to PDF. If you extract the text again it is not readable anymore.

This wouldn't be an issue if it was a conscious choice, but when I parsed a lot of born-digital PDFs we ended up with a lot that were like that from various source. Try explaining that...

Re:Embedded PDF viewer in Firefox 81 supports filling forms by colejohnson66 on Tuesday September 22, 2020 @06:22PM (#24560686)
Could it be “compacting” the fonts? So if U+0000 to U+0007F aren’t used at all, remove those glyphs and set U+0000’s glyph to be what was U+0080? Yes, I know NULL doesn’t have a glyph, but I hope that gets the idea across.
Re:Embedded PDF viewer in Firefox 81 supports filling forms by belval on Tuesday September 22, 2020 @07:09PM (#24561081)
That would be my personal guess yes, as there are other ways to "protect" PDF text like curve-based rendering.
Re:Embedded PDF viewer in Firefox 81 supports filling forms by Someone on Wednesday September 23, 2020 @06:16AM (#24565198)
Where did I say PDFs have to be in text format? I said every PDF has an equivalent text-only representation. The format, like postscript and eps started as text-only. Compression, making the files binary was added as an afterthought, to make files smaller (much smaller). If it were binary from the start, its designers would not have made the table of contents at the end waste bytes by writing offsets in ascii.

See http://blog.idrsolutions.com/?s=%22Make+your+own+PDF+file for more info on how to write PDF by hand (also shows why I said you have to be stubborn to do that)

Re:Embedded PDF viewer in Firefox 81 supports filling forms by belval on Wednesday September 23, 2020 @12:19PM (#24568711)
"OK, they added various ways of data compression, but PDF is, basically, a text-based format."

You are trying to move the goal post here. The above statement is simply untrue, PDF is not a text based format and it's that simple.

Re:Embedded PDF viewer in Firefox 81 supports filling forms by mkl on Tuesday September 22, 2020 @06:34PM (#24560789)
More. Go here and download the PDF spec.: https://www.adobe.com/devnet/pdf/pdf_reference.html

Look at Chapter 3, Syntax. The code is all text based. We are not talking about the visible characters in a PDF viewer, but the code of the PDF file itself.

Re:Embedded PDF viewer in Firefox 81 supports filling forms by roflc0ptic on Wednesday September 23, 2020 @08:20AM (#24566111)
Oh, true. I misread, and also didn't know that. Thanks for the info!
Re:Embedded PDF viewer in Firefox 81 supports filling forms by hnick on Wednesday September 23, 2020 @11:39PM (#24575017)
Going by your original premise though, just so you know the reference does indeed have examples of text as strings e.g.

BT /F13 12 Tf 288 720 Td (ABC) Tj ET

This can be extended to include spaces so you can essentially mark up entire lines of text at one time. What it can't do is cohesive paragraphs and flow/wrap, you need to use the relative positions to work out what text is in one block (and usually I'd defer to something like pdftotext for simple cases).

Laying out individual characters is common though. It's probably due to kerning concerns.

Re:Embedded PDF viewer in Firefox 81 supports filling forms by quickthrowman on Tuesday September 22, 2020 @01:07PM (#24557069)
That’s news to me and Bluebeam’s PDF search feature! It turns out you can make PDFs (This usually happens with architectural drawings) that are comprised purely of images that are not searchable, and therefore you are wrong.

I silently thank every architect that provides searchable PDFs, it makes my job way easier

Re:Embedded PDF viewer in Firefox 81 supports filling forms by mkl on Tuesday September 22, 2020 @06:31PM (#24560768)
GP is right. The code that makes up a PDF is text-based. Those images can be encoded in the PDF file using the ASCIIHexDecode filter, i.e. as editable ASCII text code.
Re:Embedded PDF viewer in Firefox 81 supports filling forms by yunohn on Wednesday September 23, 2020 @01:07AM (#24563185)
GP uses the phrases "losslessly convert to text" and "fill in the forms". I think you've misunderstood them, they're clearly talking about the display text, and not the code that comprises it.
Re:Embedded PDF viewer in Firefox 81 supports filling forms by xfer on Tuesday September 22, 2020 @06:49PM (#24560918)
Yes just use a hex editor and every data is text-based.
Re:Embedded PDF viewer in Firefox 81 supports filling forms by mkl on Tuesday September 22, 2020 @08:20PM (#24561562)
Only the "binary" bits like fonts and bitmap images would need to be hex (and then only so Notepad doesn't mangle them). Everything else in an uncompressed PDF is already text. Go here and download the PDF spec.: https://www.adobe.com/devnet/pdf/pdf_reference.html

Look at Chapter 3, Syntax (and the rest of it, really).

I literally have scripts that use bash and sed, or Python, to modify PDFs by editing the text code. Doing it in Notepad is possible but tricky, as there's a table of object byte offsets near the end that it's easy to mess up by inserting a character.