Re:Replace OCR with Vision Language Models
by rafram on Wednesday February 26, 2025 @11:13PM
(#43191291)
Then use an LLM to extract layout information. Don’t trust it to read the text.
> If the OCR model gives you back 500 words all ranging from 0.70 to 0.95 confidence, what do you do? Reject the entire document if there's a single value below 0.90?
No, of course not. You have a human review the words/segments with low confidence.
> If the OCR model gives you back 500 words all ranging from 0.70 to 0.95 confidence, what do you do? Reject the entire document if there's a single value below 0.90?
No, of course not. You have a human review the words/segments with low confidence.