Re:Vector databases: analyzing the trade-offs
by Tostino on Monday August 21, 2023 @06:29PM
(#37216194)
You absolutely want to chunk them smaller than 8k. Have you tested different chunk strategies? It can make a huge difference for actually recalling useful information in small enough chunks to be usable.
[ Parent
| on HN ]