News for hackers. Stuff that matters.

A comment on A ChatGPT mistake cost us $10k. Parent comment

Re:A ChatGPT mistake cost us $10k by dragonwriter on Sunday June 09, 2024 @06:20PM (#40628097)
> It's actually a tricky bug, because usual tests wouldn't catch it (db wiped for good isolation)

Volume/load testing (or really, any decent acceptance testing) would catch it.

[ Parent | on HN ]
Re:A ChatGPT mistake cost us $10k by viraptor on Sunday June 09, 2024 @06:27PM (#40628136)
Load testing - yes, but it's not that usual unfortunately. (Even though it should be) Acceptance testing - again, maybe, if they use 20 or so subscriptions in one batch, which may not be the case.
[ Parent | on HN ]