Re:Task-Specific LLM Evals That Do and Don't Work
by baq on Tuesday December 10, 2024 @01:35AM
(#42374369)
The problem with such takes is 1) the facts are also consistent with performance plateauing for fundamental reasons and 2) there are good, perhaps better than them, competitors with similar issues.
[ Parent
| on HN ]
Re:Task-Specific LLM Evals That Do and Don't Work
by ActionHank on Tuesday December 10, 2024 @05:41AM
(#42375605)
I think we’re on the same page here. In lieu of growing the product because of fundamental constraints they’ve opted to grow business metrics to net more revenue which in turn looks good on paper to investors.