Re:Ingesting PDFs and why Gemini 2.0 changes everything
by fallinditch on Wednesday February 05, 2025 @03:53PM
(#42954961)
If I used Gemini 2.0 for extraction and chunking to feed into a RAG that I maintain on my local network, then what sort of locally-hosted LLM would I need to gain meaningful insights from my knowledge base? Would a 13B parameter model be sufficient?
[ Parent
| on HN ]
Re:Ingesting PDFs and why Gemini 2.0 changes everything
by jhoechtl on Wednesday February 05, 2025 @04:55PM
(#42955807)
Ypur lovalodel has littleore to do but stitch the already meaningzl pieces together.
The pre-step, chunking and semantic understanding is all that counts.
Re:Ingesting PDFs and why Gemini 2.0 changes everything
by yeahwhatever10 on Wednesday February 05, 2025 @07:36PM
(#42957472)
Do you get meaningful insights with current RAG solutions?
Re:Ingesting PDFs and why Gemini 2.0 changes everything
by fallinditch on Wednesday February 05, 2025 @09:47PM
(#42958403)
Yes. For example, to create AI agent 'assistants' that can leverage a local RAG in order to assist with specialist content creation or operational activities.