News for hackers. Stuff that matters.
Re:A ChatGPT mistake cost us $10k by AdamJacobMuller on Sunday June 09, 2024 @06:12PM (#40628053)
The fact that they couldn't find it by looking at error logs is weird to me.

This is an entirely forgivable error but should have been found the first time they got an email about it:

"Oh, look, the error logs have a duplicate key exception for the primary key, how do we generate primary keys.... (facepalm)"

Funnily enough, I saw the error in their snippet as soon as I read it but dismissed it thinking there was some new-fangled python feature which allowed that to work like the function def defines that default= accepts only functions so the function gets passed? -- I haven't kept up with modern python and that sounds cool and I figured the bug couldn't be THAT simple.

Re:A ChatGPT mistake cost us $10k by dalemhurley on Sunday June 09, 2024 @08:27PM (#40628802)
I was wondering that too. Why wouldn’t the error be in the logs?
Re:A ChatGPT mistake cost us $10k by throwaway346434 on Sunday June 09, 2024 @08:42PM (#40628891)
Guess: the logs were on an ec2 instance that was thrown away regularly, and the overnight reports didn't give reproduce steps or timestamps; so when they checked it "works fine".

There's value in having your backtrace surfaced to end users rather than swallowing an exception and displaying "didn't work".

Re:A ChatGPT mistake cost us $10k by AdamJacobMuller on Sunday June 09, 2024 @10:59PM (#40629720)
it was on some temporary AWS service like lambda or something? (We had eight ECS tasks on AWS, all running five instances of our backend), but, regardless logs should be somewhere persistent.

If they weren't, that should be the first thing you fix.

Re:A ChatGPT mistake cost us $10k by 8n4vidtmkvmk on Sunday June 09, 2024 @10:06PM (#40629448)
I don't think showing stack traces to users is good practice? Every time one of my users gets a didn't work message I log the stack trace instead.
Re:A ChatGPT mistake cost us $10k by dalemhurley on Monday June 10, 2024 @12:30AM (#40630164)
Why would you show them a stack trace? This should be logged.
Re:A ChatGPT mistake cost us $10k by erhaetherth on Wednesday June 12, 2024 @10:36PM (#40665378)
That's what I said. Parent said

> There's value in having your backtrace surfaced to end users