News for hackers. Stuff that matters.
Re:Llama 2 – Meta AI by losteric on Tuesday July 18, 2023 @01:59PM (#36776711)
Develop a set of queries for the use-case with human review of outputs. My team has an internal (corporate) tool where we drop in an S3 file, complete text over K models, then evaluate the completions with appropriate humans labor pools. Each evaluator gets a pair of outputs for the same prompt and picks the best.

There are no comments on this comment yet.