News for hackers. Stuff that matters.
Re:Grok by bbig on Monday March 18, 2024 @05:58AM (#39742020)
Claude 3 Opus is reporting superior metrics, particularly in its coding ability, and in the LLM Arena it is statistically tied with GPT-4.
Re:Grok by int_19h on Monday March 18, 2024 @02:27PM (#39748049)
When it comes to LLMs, metrics are misleading and easy to game. Actually talking to it and running it through novel tasks that require ability to reason very quickly demonstrates that it is not on par with GPT-4. As in, it can't solve things step-by-step that GPT-4 can one-shot.
Re:Grok by FloorEgg on Monday March 18, 2024 @04:11PM (#39749363)
This was exactly my experience. I have very complex prompts and I test them on new models and nothing performs as well as GPT-4 that I've tried (Claude 3 Opus included)
Re:Grok by astrange on Monday March 18, 2024 @04:53PM (#39749880)
It's a bit better at writing jokes. GPT is stiff and unfunny - which is why the twitter spambots using it to generate text are so obvious.