picohen
I went into a Youtube rabbit hole the other night...
Additionally, there might be a potential route where both are used, depending on the use case.
Feel free to dm if you want to chat further on this!
Show HN: Neum AI – Open-source large-scale RAG framework
https://github.com/NeumTry/NeumAI
Over the last couple months we have been supporting developers in building large-scale RAG pipelines to process millions of pieces of data.We documented our approach in an HN post (https://news.ycombinator.com/item?id=37824547) a couple weeks ago. Today, we are open sourcing the framework we have developed.The framework focuses on RAG data pipelines and provides scale, reliability, and data...
The bulk of the data is getting refreshed by Tweets from all of the candidates. We also pull in data from public sources such as wikipedia and ballotpedia (the bot outputs the sources used) And we also pull in from transcripts of interviews the candidates have had, again, if a piece of indo was used from any of these sources, we show it to the user
Show HN: ElectionGPT – easy-to-consume information about U.S. candidates
RAG at scale: Synchronizing and ingesting billions of text embeddings
Sync source data with vector stores in real time [video]
Efficiently sync context for your LLM application
Show HN: Neum AI – Improve your AI's accuracy with up-to-date context
While building Gen AI apps, we found that passing context to the prompt is crucial. However, the context must be accurate and up to date. If you are doing search over a vector database and that DB is not updated, then the search results are not good and the quality of your context will suffer.With this, we set to create an easy-to-use UX and a set of APIs that help you manage and synchronize...