Re:Autonomous Agents and Agent Simulations
by LawTalkingGuy on Thursday April 20, 2023 @01:42AM
(#35636791)
I think Langchain is currently broader, containing those text-splitting and indexing tools as well as summarization and memory, 'Tool' integration, etc.
Re:Autonomous Agents and Agent Simulations
by freezed88 on Thursday April 20, 2023 @01:49AM
(#35636829)
author of llamaindex here:
there's some overlap but our primary use case is going deep into indexing+retrieval for LLM's (and going deep in that area). Not really doing agents/chatbots/prompt management/etc.
E.g. this is a good example of our use cases: https://gpt-index.readthedocs.io/en/latest/use_cases/queries...
You can actually use us as a retrieval/tool in langchain too: https://gpt-index.readthedocs.io/en/latest/how_to/integratio...
Re:Autonomous Agents and Agent Simulations
by jn2clark on Thursday April 20, 2023 @02:24AM
(#35637004)
Not sure on your interest/use case but something that is designed for "documents in" -> "documents out" is here https://github.com/marqo-ai/marqo. It does retrieval using embeddings and combines all the text splitting and inference operations and can be easily deployed to production (its designed for that, not pip install). Works across images and allows for multi-vector representations.
Can someone more knowledgeable chime in?