News for hackers. Stuff that matters.
Re:A ChatGPT mistake cost us $10k by zeroonetwothree on Sunday June 09, 2024 @09:02PM (#40629035)
It makes your tests more robust. Generally you don’t want tests that are too sensitive to external state since they will fail spuriously and become useless.
Re:A ChatGPT mistake cost us $10k by brigadier132 on Sunday June 09, 2024 @09:22PM (#40629176)
Of course your tests shouldn't be sensitive to external state. Why would other tests running affect your test?
Re:A ChatGPT mistake cost us $10k by viraptor on Sunday June 09, 2024 @11:55PM (#40629985)
They shouldn't. But they do. We're not perfectly spherical developers and we all make mistakes. Sometimes it's also extremely tricky to figure out what state is leaking, especially is it's an access race issue and happens only for some tests and very rarely. If you haven't seen that happening, you just need to work on larger projects.
Re:A ChatGPT mistake cost us $10k by brigadier132 on Monday June 10, 2024 @11:45AM (#40634817)
I've worked at several large companies tyvm. In our e2e tests we did not isolate dbs. If the test failed because of other tests running that's a bug in the test and that person would get automatically @mentioned on slack and they would have to fix the build.