News for hackers. Stuff that matters.
Re:Task-Specific LLM Evals That Do and Don't Work by michaelt on Monday December 09, 2024 @12:22PM (#42368112)
There were some models in the past [1] that were extremely keen to produce chatty noise, even when you explicitly asked them not to.

Of course this was back in May 2023, so things might have improved since then.

[1] https://news.ycombinator.com/item?id=35964018

There are no comments on this comment yet.