Re:Stirling-PDF: local web application to perform various op...
by brianjking on Monday December 25, 2023 @05:56PM
(#38767095)
I second this, that or have you tried GPT-4 Vision or Donut?
[ Parent
| on HN ]
Re:Stirling-PDF: local web application to perform various op...
by d4rkp4ttern on Monday December 25, 2023 @06:53PM
(#38767482)
Still waiting for GPT4V but doubt it will do this. Yes I’ve tried Donut and other options but this is a very gnarly problem.
One option is to extract text blocks along with their coordinates (unstructured.io gives this, probably based on another pkg because it’s basically a container for many pigs). Then do the same with a blank template, and you then have an algorithmic problem of matching the filled values spatially with the key locations from the template.
Re:Stirling-PDF: local web application to perform various op...
by brianjking on Monday December 25, 2023 @06:54PM
(#38767496)
I'm fairly confident GPT-4V will do this just fine, tbh.
You just need to extract each of the elements into a structured JSON or something, right?
I'll try with your example later today.
Re:Stirling-PDF: local web application to perform various op...
by d4rkp4ttern on Monday December 25, 2023 @07:05PM
(#38767592)
Exactly, the form has filled values in named cells, so we need a JSON of cellName -> filledValue mappings.
Let me know how GPT-4V does!
Re:Stirling-PDF: local web application to perform various op...
by qingcharles on Monday December 25, 2023 @06:04PM
(#38767170)
I second trying GPT-4 Vision, though they have dumbed it down a bit since launch.