News for hackers. Stuff that matters.
Re: by remilouf on Thursday May 02, 2024 @10:53AM (#40237005)
LLM evaluations are very sensitive to the details of the prompt's structure. This post shows how using structured generation reduces the results' variance and the ranking shifts.