News for hackers. Stuff that matters.
Re:AI Blindspots – Blindspots in LLMs I've noticed while AI ... by skerit on Thursday March 20, 2025 @07:46AM (#43421877)
Claude Sonnet 3.7 really, really loves to rewrite tests so they'll pass. I've had it happen many times in a claude-code session, I had to add this to each request (though it did not fix it 100%)

    - Never disable, skip, or comment out failing unit tests. If a unit test fails, fix the root cause of the exception.
    - Never change the unit test in such a way that it avoids testing the failing feature (e.g., by removing assertions, adding empty try/catch blocks, or making tests trivial).
    - Do not mark tests with @Ignore or equivalent annotations.
    - Do not introduce conditional logic that skips test cases under certain conditions.
    - Always ensure the unit test continues to properly validate the intended functionality.
Re:AI Blindspots – Blindspots in LLMs I've noticed while AI ... by jsight on Thursday March 20, 2025 @12:06PM (#43425094)
I'm guessing this is a side effect of mistakes in the reinforcement learning face. It'd be really easy to build a reward model that favors passing tests, without properly measuring the quality of those tests.