Re:Show HN: ColBERT Build from Sentence Transformers
by raphaelty on Saturday November 18, 2023 @07:23AM
(#38318734)
In the documentation there is an evaluation module with detailed informations. The idea is to gather relevant pairs of queries and documents that are not part of the training set. Then the idea is to measure, using various metrics, how your model can retrieve accurate documents.
Do you have advice for how to measure the quality of the finetuning beyond seeing the loss drop?