Replace OCR with Vision Language Models

Re:Replace OCR with Vision Language Models by KoolKat23 on Thursday February 27, 2025 @09:42AM (#43194785)

I've been using gemini 2 flash to extract financial data, within my sample which is perhaps small (probably 1000 entries so far), I've had one single error only so like a 99.9% success rate.

(There's slightly more errors if I ask it to add numbers but this isn't OCR and a bit more of a reach, although it is very good at this too regardless).

Many hallucinations can be avoided by telling it to use null if there is no number present.

[ Parent | on HN ]

Re:Replace OCR with Vision Language Models by CarolineRommer on Thursday February 27, 2025 @12:37PM (#43196552)

And by using two different systems (say Gem plus ChatGPT) you essentially reduce chances of hallucination to zero, no? You would need to be VERY unlucky to find to LLMs hallucinating the exact same response.

[ Parent | on HN ]