News for hackers. Stuff that matters.
Re:Claude 4 by XCSme on Thursday May 22, 2025 @05:47PM (#44067464)
It's weird that Opus4 is the worst at one-shot, it requires on average two attempts to generate a valid query.

If a model is really that much smarter, shouldn't it lead to better first-attempt performance? It still "thinks" beforehand, right?

Re:Claude 4 by riwsky on Friday May 23, 2025 @07:57AM (#44072031)
Don’t talk to Opus before it’s had its coffee. Classic high-performer failure mode.