Re:Ask HN: Is RAG the Future of LLMs?
by cl42 on Monday April 15, 2024 @03:47PM
(#40044848)
Do you have a problem with LangChain and LlamaIndex due to their changing codebases/APIs/etc., or do you think there's a fundamental issue with RAG itself?
[ Parent
| on HN ]
Re:Ask HN: Is RAG the Future of LLMs?
by mark_l_watson on Monday April 15, 2024 @04:59PM
(#40045513)
Maybe a mixture of both?
I think both projects were super useful, grateful for them. There is a lot of utility tucked away in both projects.
A year ago,I started using LLM APIs in non-Python languages and realized that sometimes building from scratch is better.
Thanks for clarifying. I generally agree with you -- I prefer direct API calls versus weird/poor abstractions. The only abstraction I use is one that standardizes the API calls/data structures between Gemini/GPT-x/Llama 2/Claude.
That being said, I do use RAG a lot (though generally code most of the implementations myself).
Fast changing libraries are a huge pain. That's why a no-code approach like Unstract (https://github.com/zipstack/unstract) makes sense.