News for hackers. Stuff that matters.
Re:Grok3 Launch by johnfn on Tuesday February 18, 2025 @11:56AM (#43092020)
Chatbot arena leaderboard[1] says otherwise. 4o is ahead now, but that version of 4o was released after r1. r1 was ahead of all version of 4o and o1 at the time of release.

https://huggingface.co/spaces/lmarena-ai/chatbot-arena-leade...

Re:Grok3 Launch by mwigdahl on Tuesday February 18, 2025 @11:38PM (#43098637)
Chatbot arena leaderboard is a good test for vibes and style of response, but not much else. R1's performance in objective benchmarks (coding, etc.) showed very good performance, granted, but inferior to the full o1 and o1-pro models.

It's still a very impressive feat, but it wasn't frontier-pushing.