News for hackers. Stuff that matters.
Re:Vector indexing all of Wikipedia on a laptop by riku_iki on Wednesday May 29, 2024 @04:02PM (#40516336)
What is the end task(e.g. RAG, or just vector search for question answering), are you satisfied with results in terms of quality?
Re:Vector indexing all of Wikipedia on a laptop by gfourfour on Wednesday May 29, 2024 @05:14PM (#40517094)
The end result is a recommendation algorithm, so basically just vector similarity search (with a bunch of other logic too ofc). The quality is great, and if anything a little bit of underfitting is desirable to avoid the “we see you bought a toilet seat, here’s 50 other toilet seats you might like” effect.