Re:Claude 3.7 Sonnet and Claude Code
by bufferoverflow on Monday February 24, 2025 @04:47PM
(#43165334)
This test isn't stupid. If it can't count the number of letters in a text, can you rely on it with more important calculations?
[ Parent
| on HN ]
Not on calculations that involve counting at a sub-token level. Otherwise, it depends.
You can rely on it for anything that you can validate quickly. And it turns out, there are a lot of problems which are trivial to validate the solution to, but difficult to build the solution.