News for hackers. Stuff that matters.
Re:Claude 3.7 Sonnet and Claude Code by bufferoverflow on Monday February 24, 2025 @04:47PM (#43165334)
This test isn't stupid. If it can't count the number of letters in a text, can you rely on it with more important calculations?
Re:Claude 3.7 Sonnet and Claude Code by TeMPOraL on Monday February 24, 2025 @08:03PM (#43166849)
Not on calculations that involve counting at a sub-token level. Otherwise, it depends.
Re:Claude 3.7 Sonnet and Claude Code by stnmtn on Monday February 24, 2025 @05:23PM (#43165641)
You can rely on it for anything that you can validate quickly. And it turns out, there are a lot of problems which are trivial to validate the solution to, but difficult to build the solution.
Re:Claude 3.7 Sonnet and Claude Code by 101008 on Monday February 24, 2025 @06:00PM (#43165963)
Coding is not one of those cases or edge cases wouldn't exists