News for hackers. Stuff that matters.
Re:Ask HN: How are teams validating AI-generated tests today? by itigges22 on Tuesday March 10, 2026 @08:37AM (#47322425)
For security vunerability testing on websites I have been making for clients- I almost always hire a senior developer to look over the work and or tests that were created. AI can pass a test, and it can make something that passes a test, but there almost ALWAYS are problems that the senior dev finds with the tests, or with the code that was being tested. Sometimes AI will adjust the code entirely to pass the test or adjust the test to pass failing code.

Another counter-measure I have is to simply lock code before testing. Look over test files, and ensure its not following the happy path.

Re:Ask HN: How are teams validating AI-generated tests today? by sriramgonella on Tuesday March 10, 2026 @09:28AM (#47322994)
can we even depend on End to end Testing on this AI Tools? but how far these founders can able to rely on that with confidence. I totaly agree for VAPT it will be better
Re:Ask HN: How are teams validating AI-generated tests today? by itigges22 on Tuesday March 10, 2026 @02:40PM (#47327179)
In my opinion they cannot confidently rely on it- I think its great to get a product out there, but I think we can draw parallels to things like Dropshipping- where the "Get quick rich" thought process is a major failure. Its better to think about it as that you still need a large amount of energy, time, or capital to achieve a certain level of success. (INCLUDING production coding projects that req security and strong engineering practices). We can use Spec Driven AI Assisted coding to add a level of rigor to "vide coding", but I still don't think models are where they need to be in order to get it perfect. We will almost always have issues.