News for hackers. Stuff that matters.

A comment on Grok3 Launch. Parent comment

Re:Grok3 Launch by riku_iki on Tuesday February 18, 2025 @02:28AM (#43086946)
And DeepSeek is just 3% behind. It seems in that benchmark all LLMs perform well and top is formed within some statistical error.
[ Parent | on HN ]
Re:Grok3 Launch by rvnx on Tuesday February 18, 2025 @04:25AM (#43087702)
It could also be that they got "inspired" by DeepSeek, hence the very similar results.

So it could be that their success is mostly about taking an open and free thing, and turned it proprietary.

[ Parent | on HN ]
Re:Grok3 Launch by torginus on Tuesday February 18, 2025 @05:38AM (#43088125)
These percentage points don't mean anything. Look up how the Elo system works. They just add 1000 to the result to make it a nicer number.
[ Parent | on HN ]
Re:Grok3 Launch by riku_iki on Tuesday February 18, 2025 @10:31AM (#43090653)
There are llms below 1000 in the leaderboard
[ Parent | on HN ]
Re:Grok3 Launch by torginus on Wednesday February 19, 2025 @09:30AM (#43102506)
So? Percentage points are only meaningful when the mean of the dataset is 0, which is not the case here.
[ Parent | on HN ]