News for hackers. Stuff that matters.
Re:Claude 3.7 Sonnet and Claude Code by jrflowers on Tuesday February 25, 2025 @02:24AM (#43169163)
>I try not to let perfect be the enemy of good. All benchmarks have limitations.

Overfitting is one of the fundamental issues to contend with when trying to figure out if any type of model at all is useful. If your leaderboard corresponds to vibes and that is your target, you could just have a vibes leaderboard

There are no comments on this comment yet.