Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on RAG at scale: Synchronizing and ingesting billions of text embeddings. Parent comment
You’ll probably want to start with the standard rank-based metrics like MRR, nDCG, and precision/recall@K.
Plus if you’re going to spend $$$ embedding tons of docs you’ll want to compare to a “dumb” baseline like bm25.
There are no comments on this comment yet.
You’ll probably want to start with the standard rank-based metrics like MRR, nDCG, and precision/recall@K.
Plus if you’re going to spend $$$ embedding tons of docs you’ll want to compare to a “dumb” baseline like bm25.