Re:A hyper-fast local vector database for use with LLM Agents
by kristianp on Monday April 17, 2023 @02:04AM
(#35597286)
References "[Submitted on 31 Mar 2023]
Programmed but Arbitrary Control Minimization of Amplitude and phase for speckle Nulling (PACMAN)"
https://arxiv.org/abs/2303.18231
Re:A hyper-fast local vector database for use with LLM Agents
by celestialcheese on Sunday April 16, 2023 @11:25PM
(#35596553)
Damn this is good - well played.
For those who aren't neck deep in LLM hype - ChromaDB raised $18m at a $75m valuation a couple weeks ago with what's essentially just a thin wrapper around duckdb with a parquet import/export for persistence.
Re:A hyper-fast local vector database for use with LLM Agents
by merpnderp on Sunday April 16, 2023 @11:28PM
(#35596567)
I couldn't believe they were raising $35 million rounds with a brand new embedding database that was open source. Then I poked through the dozens of lines of code and realized they had implemented the same DB I had.
Re:A hyper-fast local vector database for use with LLM Agents
by jdaggers on Monday April 17, 2023 @11:33AM
(#35602296)
Author here. Yes, it actually does work. If I’m ever indexing fewer than ~100k documents/paragraphs I would use something like this approach rather than reaching for a vector database.
Re:A hyper-fast local vector database for use with LLM Agents
by jdaggers on Monday April 17, 2023 @12:53AM
(#35596970)
Yeah, this was a little strange. I'm the author of the repo linked here.
I got alerted to it hitting #1 on HN and was able to see it there for only a little bit before it immediately got tanked to # 60. I'm a little bummed, but c'est la vie.
This was a great laugh. Also, after the benchmark, it says:
> Benchmark Credit: Benim Kıçım
"Benim Kıçım" means "my ass" in Turkish.
No idea if that's a joke paper.
Instant classic.
For those who aren't neck deep in LLM hype - ChromaDB raised $18m at a $75m valuation a couple weeks ago with what's essentially just a thin wrapper around duckdb with a parquet import/export for persistence.
LOL, much funny.
I found it crazy to run auto-GPT with an external DB over the internet, how can this be ever fast and efficient? (unless the dataset is humongous)
I got alerted to it hitting #1 on HN and was able to see it there for only a little bit before it immediately got tanked to # 60. I'm a little bummed, but c'est la vie.
Great satire in any case! Strikes the perfect balance between highly plausible and glaringly obvious.
Y-axis on this chart is actually hilarious