News for hackers. Stuff that matters.
Re:Claude 4 by joelthelion on Thursday May 22, 2025 @03:35PM (#44065896)
Did you try Sonnet 4?
Re:Claude 4 by vladimirralev on Thursday May 22, 2025 @03:40PM (#44065964)
It's placed at 10. Below claude-3.5-sonnet, GPT 4.1 and o3-mini.
Re:Claude 4 by _peregrine_ on Thursday May 22, 2025 @03:49PM (#44066054)
yeah this was a surprising result. of course, bear in mind that testing an LLM on SQL generation is pretty nuanced, so take everything with a grain of salt :)