News for hackers. Stuff that matters.

A comment on Show HN: Morphik – Open-source RAG that understands PDF images, runs locally. Parent comment

Re:Show HN: Morphik – Open-source RAG that understands PDF i... by Adityav369 on Tuesday April 22, 2025 @05:41PM (#43766596)
You can run this fully locally using Ollama for inference, although you'll need larger models and a beefy machine for great results. On my end llama 3.2 8B does a good job on technical docs, but bigger the better lol.
[ Parent | on HN ]
Re:Show HN: Morphik – Open-source RAG that understands PDF i... by thot_experiment on Tuesday April 22, 2025 @07:48PM (#43767366)
Ahh, I didn't see that, I just saw them talking about a free tier or whatever and my eyes glazed over. I'll try it out with Mistral-small 3.1 at some point tonight, I've been having really great results with it's multimodal understanding.
[ Parent | on HN ]
Re:Show HN: Morphik – Open-source RAG that understands PDF i... by mrtimo on Tuesday April 22, 2025 @10:44PM (#43768211)
how would you use this within open-web-ui locally?
[ Parent | on HN ]