DeepEval – Unit Testing for LLMs

Re:DeepEval – Unit Testing for LLMs by fswd on Thursday August 17, 2023 @12:49PM (#37164538)

Are there any large or publically shared evaluation datasets and corresponding question and answer validation data?

[ Parent | on HN ]

Re:DeepEval – Unit Testing for LLMs by jacky2wong on Thursday August 17, 2023 @01:17PM (#37165024)

A few publically shared evaluation datasets include:

- HuggingFace Evaluate (and their 3 dashboards) - OpenAIEval - AnthropicEval

[ Parent | on HN ]

Re:DeepEval – Unit Testing for LLMs by intended on Friday August 18, 2023 @12:40AM (#37171461)

I would not use those for production.

I would assume your backend model is already tested on these.

You would need a novel data set.

[ Parent | on HN ]