News for hackers. Stuff that matters.
Re:AlphaProof Code by mkoryak on Tuesday November 10, 2026 @10:55AM (#50442160)
This is why I think tests are useless if written by AI. They will always pass and look reasonable.
Re:AlphaProof Code by nicce on Tuesday November 10, 2026 @01:50PM (#50444506)
ALL TESTS ARE GREEN, ALL GOOD.

And then you need to remind that it does not matter, if they are empty.

Re:AlphaProof Code by andai on Wednesday November 11, 2026 @06:21AM (#50452109)
Oh it gets even stupider. When Claude web introduced the "computer" stuff last year, I had it port an interpreter to a different language. It did it in one shot, I was very impressed.

It even volunteered tests.

Then I read the tests. It was just a bunch of console log statements saying "Test passed!" and didn't actually test anything...