Grok 3: Another win for the bitter lesson

Re:Grok 3: Another win for the bitter lesson by melodyogonna on Thursday February 20, 2025 @04:49AM (#43112886)

How can it be specifically trained on benchmarks when it is leading on blind chatbot tests?

The post you quoted is not a Grok problem if other LLMs are also failing, it seems, to me, to be a fundamental failure in the current approach to AI model development.

[ Parent | on HN ]

Re:Grok 3: Another win for the bitter lesson by bearjaws on Thursday February 20, 2025 @07:15AM (#43113802)

Any LLM that is uncensored does well on Chatbot tests because a refusal is an automatic loss.

And since 30% of people using Chatbots are Gooning it up theres far more refusals...

[ Parent | on HN ]

Re:Grok 3: Another win for the bitter lesson by pyinstallwoes on Thursday February 20, 2025 @10:51AM (#43116167)

Gooning?

[ Parent | on HN ]

Re:Grok 3: Another win for the bitter lesson by bearjaws on Thursday February 20, 2025 @01:03PM (#43118014)

https://www.urbandictionary.com/define.php?term=gooning

[ Parent | on HN ]

Re:Grok 3: Another win for the bitter lesson by nycdatasci on Thursday February 20, 2025 @10:04AM (#43115538)

I think a more plausible path to gaming benchmarks would be to use watermarks in text output to identify your model, then unleash bots to consistently rank your model over opponents.

[ Parent | on HN ]