Re:Show HN: LLM App – build a realtime LLM app in 30 lines, ...
by anupsurendran on Thursday July 27, 2023 @10:01PM
(#36902389)
Thanks for these links. I also had a thread around alternatives to vector databases going on today on Linkedin https://www.linkedin.com/feed/update/urn:li:activity:7090376... . What is the criteria to go for a vector index vs vector database?
Re:Show HN: LLM App – build a realtime LLM app in 30 lines, ...
by janchorowski on Friday July 28, 2023 @03:23AM
(#36903933)
An index is a software component building block, which becomes a database when wrapped with the data management system. We will see more and more traditional databases to add a vector-search index, for instance pgvector makes a vector database out of PostgreSQL.
The LLM App is meant to be self-sufficient and takes a "batteries included" approach to system development - rather than combine several separate applications into a large deploymet, that includes databases, orchestrators, ETL pipelines it combines several software components, such as connectors and indexes into a single app which can be directly deployed with no extra dependencies.
Such an approach should make the deployments easier (there are fewer moving parts to monitor and service), while also being more hackable - e.g. adding some more logic on top of nearest neighbor retrieval is easy and adds only a few statements to the code.
Re:Show HN: LLM App – build a realtime LLM app in 30 lines, ...
by anupsurendran on Friday July 28, 2023 @11:24AM
(#36908227)
I understand much better. Thanks. So this is much more programmer extensible and possibly get data from other sources (not just unstructured data).
- https://github.com/pathwaycom/llm-app/blob/main/llm_app/path... for the simplest contextless app
- https://github.com/pathwaycom/llm-app/blob/main/llm_app/path... for the default app that builds a reactive index of context documents
- https://github.com/pathwaycom/llm-app/blob/main/llm_app/path... for the contextful app reading data from s3
- https://github.com/pathwaycom/llm-app/blob/main/llm_app/path... for the app using locally available models