News for hackers. Stuff that matters.
Re:Vector databases: analyzing the trade-offs by Tostino on Monday August 21, 2023 @06:29PM (#37216194)
You absolutely want to chunk them smaller than 8k. Have you tested different chunk strategies? It can make a huge difference for actually recalling useful information in small enough chunks to be usable.
Re:Vector databases: analyzing the trade-offs by philbo on Tuesday August 22, 2023 @03:21AM (#37219671)
Thanks for the tip, I haven't played around with chunk size much at all so far.