News for hackers. Stuff that matters.
Re:Evaluating Rag Parameters Using Tvalmetrics by joewferrara on Wednesday November 01, 2023 @10:44AM (#38098856)
Author here. The linked Jupyter notebook shows how to use tvalmetrics, a RAG metrics Python package, to evaluate RAG query engines built using LlamaIndex on a dataset of Paul Graham essays about startup founders. The RAG parameters chunk size and number of retrieved context chunks are varied and tvalmetrics is used to show which choice of chunk size and number of retrieved context chunks is optimal.

There are no comments on this comment yet.