News for hackers. Stuff that matters.
Re:Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku by hobofan on Tuesday October 22, 2024 @12:07PM (#41915734)
> Which ones are you looking at? Since the benchmark comparison in the blogpost itself doesn't include Opus at all.

I manually compared it with the values from the benchmarks they published when they originally announced the Claude 3 model family[0].

Not all rows have a 1:1 row in the current benchmarks, but I think it paints a good enough picture.

[0]: https://www.anthropic.com/news/claude-3-family

There are no comments on this comment yet.