News for hackers. Stuff that matters.

A comment on Llama-Scan: Convert PDFs to Text W Local LLMs. Parent comment

Re:Llama-Scan: Convert PDFs to Text W Local LLMs by GaggiX on Sunday August 17, 2025 @10:27PM (#44936792)
>are cheap and strong enough to make this practical.

It all depends on the scale you need them, with the API it's easy to generate millions of tokens without thinking.

[ Parent | on HN ]
Re:Llama-Scan: Convert PDFs to Text W Local LLMs by rdos on Monday August 18, 2025 @01:59AM (#44937813)
In that case you should run a model locally, this one for example: https://huggingface.co/ds4sd/docling-models
[ Parent | on HN ]
Re:Llama-Scan: Convert PDFs to Text W Local LLMs by agentcoops on Monday August 18, 2025 @07:30AM (#44939467)
You don't need full reasoning to get accurate results, so even with GPT5 it's still pretty cheap for a one-time job and easy to reason about costs. It's certainly cheaper if you have data where reliability is key and classical OCR will undoubtedly require some manual data cleaning...

I can recommend the Mistral OCR API [1] if you have large jobs and don't want to think about it too much.

[1] https://mistral.ai/solutions/document-ai

[ Parent | on HN ]