Re:Task-Specific LLM Evals That Do and Don't Work
by michaelt on Monday December 09, 2024 @12:22PM
(#42368112)
There were some models in the past [1] that were extremely keen to produce chatty noise, even when you explicitly asked them not to.
Of course this was back in May 2023, so things might have improved since then.
Though it's worth noting that I often do want an explanation, and currently my workflow is to just use a different LLM.