News for hackers. Stuff that matters.
Re:Ask HN: RAG and unstructured data from several docs by calculito on Thursday May 30, 2024 @11:07AM (#40524642)
Thanks for the comments. Regarding re-chunking: I assume the models, the strategies, the dependencies are continuously checken, improved and adapted. I would assume also a re-chunking should be necessary. Not every day of course, but how I can assess the quality of my chunking? Running in parallel benchmarks on two different chunking strategies? Thats means I would need to do double work, creating and using continuously two different chunk systems. Any ideas how to evaluate the quality and performance of my chunking strategy?

There are no comments on this comment yet.