News for hackers. Stuff that matters.
Re:Launch HN: Midship (YC S24) – Turn PDFs and Images into u... by tlofreso on Wednesday November 06, 2024 @02:06PM (#42067560)
"accurate document extraction is becoming a commodity with powerful VLMs"

Agree.

The capability is fairly trivial for orgs with decent technical talent. The tech / processes all look similar:

User uploads file --> Azure prebuilt-layout returns .MD --> prompt + .MD + schema set to LLM --> JSON returned. Do whatever you want with it.

Re:Launch HN: Midship (YC S24) – Turn PDFs and Images into u... by Kiro on Wednesday November 06, 2024 @04:09PM (#42069425)
Why all those steps? Why not just file + prompt to JSON directly?
Re:Launch HN: Midship (YC S24) – Turn PDFs and Images into u... by tlofreso on Wednesday November 06, 2024 @04:55PM (#42070089)
Having the text (for now) is still pretty important for quality output. The vision models are quite good, but not a replacement for a quality OCR step. A combination of Text + Vision is compelling too.
Re:Launch HN: Midship (YC S24) – Turn PDFs and Images into u... by kietay on Wednesday November 06, 2024 @02:45PM (#42068181)
Totally agree that this is becoming the standard "reference architecture" for this kind of pipeline. The only thing that complicates this a lot today is complex inputs. For simple 1-2 page PDFs what you describes works quite well out of the box but for 100+ page doc it starts to fall over in ways I described in another comment.
Re:Launch HN: Midship (YC S24) – Turn PDFs and Images into u... by tlofreso on Wednesday November 06, 2024 @03:21PM (#42068732)
Are really large inputs solved at midship? If so, I'd consider that a differentiator (at least today). The demo's limited to 15pgs, and I don't see any marketing around long-context or complex inputs on the site.

I suspect this problem gets solved in the next iteration or two of commodity models. In the meantime, being smart about how the context gets divvied works ok.

I do like the UI you appear to have for citing information. Drawing the polygons around the data, and then where they appear in the PDF. Nice.