Re:Show HN: Open-Source DocumentAI with Ollama
by codelion on Saturday March 08, 2025 @06:04PM
(#43304395)
yeah, chunking seems to be the key for any decent RAG implementation... it's interesting how much the retrieval strategy impacts the final answer quality. i've seen some community members mention that even with chunking, things like chunk overlap and smart metadata can significantly improve results. also, presenting search results to the user alongside the AI summary is a great point.
[ Parent
| on HN ]
Re:Show HN: Open-Source DocumentAI with Ollama
by Dontizi on Saturday March 08, 2025 @08:17PM
(#43305240)
This is my next step. Currently, I’ve built an MVP to test the features, integrations, and see how far I can go with rLlama. I’m already developing a RAG on my end by chunking the data, adding overlap, and using metadata to retrieve the best possible context. This should be deployed soon. The version on GitHub has been pushed for days now, and it was only a version to showcase the features. I can’t wait to improve it and make it useful for everyone!