News for hackers. Stuff that matters.
Re:Exact Binary Vector Search for RAG in 100 Lines of Julia by jjnoakes on Friday May 17, 2024 @06:57PM (#40394933)
Some (not all) of your questions may be answered by the linked article near the top of the submitted article, which goes into more detail about how much is lost quantizing to 1 bit (and 1 byte): https://huggingface.co/blog/embedding-quantization

There are no comments on this comment yet.