News for hackers. Stuff that matters.
Re:Veo by aragonite on Tuesday May 14, 2024 @03:46PM (#40359348)
With so much recent focus by OpenAI/Google on AI's visual capabilities, does anyone know when we might see an OCR product as good as Whisper for voice transcription? (Or has that already happened?) I had to convert some PDFs and MP3s to text recently and was struck by the vast difference in output quality. Whisper's transcription was near-flawless, all the OCR softwares I tried struggled with formatting, missed words, and made many errors.
Re:Veo by jazzyjackson on Tuesday May 14, 2024 @04:58PM (#40360084)
You might enjoy this breakdown of the lengths one person went through to take advantage of the iOS vision API and creating a local web service for transcribing some very challenging memes:

https://findthatmeme.com/blog/2023/01/08/image-stacks-and-ip...

discussed on HN:

https://news.ycombinator.com/item?id=34315782

Re:Veo by aragonite on Tuesday May 14, 2024 @05:15PM (#40360249)
This is so good - thanks for sharing this!
Re:Veo by nunez on Tuesday May 14, 2024 @11:33PM (#40362812)
This is a work of fucking art.
Re:Veo by thesandlord on Tuesday May 14, 2024 @05:43PM (#40360500)
We use GPT-4o for data extraction from documents, its really good. I published a small library that does a lot of the document conversion and output parsing: https://npmjs.com/package/llm-document-ocr

For straight OCR, it does work really well but at the end of the day its still not 100%

Re:Veo by aragonite on Tuesday May 14, 2024 @06:27PM (#40360878)
Thanks! look forward to checking this out as soon as I get home.