News for hackers. Stuff that matters.
Re:GPT-5.5 by dubcanada on Thursday April 23, 2026 @04:42PM (#47881630)
grok is 17%? And that's the lowest, most models are like 80%+?

While hallucination is probably closer to 100% depending on the question. This benchmark makes no sense.

Re:GPT-5.5 by elAhmo on Thursday April 23, 2026 @05:16PM (#47882157)
No one serious uses grok.
Re:GPT-5.5 by ajdegol on Thursday April 23, 2026 @05:38PM (#47882432)
@grok is this true?
Re:GPT-5.5 by NamlchakKhandro on Friday April 24, 2026 @01:15AM (#47885851)
no
Re:GPT-5.5 by for_i_in_range on Friday April 24, 2026 @09:27AM (#47889949)
This comment deserves more love
Re:GPT-5.5 by RALaBarge on Thursday April 23, 2026 @06:50PM (#47883255)
YMMV but Grok 4.1 Fast can usually find via static analysis a few things that other models dont seem to catch with the same prompt
Re:GPT-5.5 by d0gsg0w00f on Thursday April 23, 2026 @11:06PM (#47885002)
Why not? Honest question.
Re:GPT-5.5 by phillipcarter on Friday April 24, 2026 @12:27PM (#47892384)
Because the Grok models offer nothing different in serious contexts from the other leading models which don't come with a heaping pile of bad baggage.
Re:GPT-5.5 by Jensson on Thursday April 23, 2026 @11:47PM (#47885277)
> While hallucination is probably closer to 100% depending on the question.

But the benchmark didn't ask those questions, and it seems grok is very well at saying it doesn't know the answer otherwise.

Re:GPT-5.5 by MagicMoonlight on Friday April 24, 2026 @06:40AM (#47888317)
It makes sense. Grok is taught to answer the question, regardless of how explicit or extreme it is. These other models are taught to suppress any wrongthink. That's going to make it hard to answer things correctly. If you've been told to answer something incorrectly because it's wrong, then you'll have to make up an answer.