News for hackers. Stuff that matters.
Re:How is team-member-1 doing? by mulmen on Friday March 17, 2017 @05:06PM (#13898001)
What were the consequences to you, the DBA, and the organization?
Re:How is team-member-1 doing? by Pharylon on Friday March 17, 2017 @06:20PM (#13898491)
Nothing really happened in the end. I'd only worked there for about six months but my boss liked me and thought I did good work. He chalked it up as a learning experience (which it certainly was).

Our DBA was someone who'd been with the company 15 years. I think most of the blame fell on him, but he didn't lose his job or anything like that. I think the snapshot issue was pretty trivial to fix. The only real problem was that there were no notifications going to anyone that they failed.

The customer was pissed, and it was a new customer at that. They basically lost a day of deliveries out of it. But they kind of had vendor lock-in with us (the office supply company they were delivering for liked us and had basically told them to use us because we already knew how to process their data the way they wanted). Switching wouldn't have been trivial, but we nevertheless fell over ourselves to keep them happy for a few months until it blew over.

Re:How is team-member-1 doing? by keithpeter on Friday March 17, 2017 @05:41PM (#13898224)
I'm interested to know as well.

I imagine that getting the snapshots working properly would be quite an important factor, otherwise the company would always be a typing error away from chaos.

Re:How is team-member-1 doing? by lightbritefight on Friday March 17, 2017 @07:03PM (#13898728)
Working snapshots/backups are system engineers number 1 concern, always. They mitigate issues with every other system, of any scope. Its the first thing a new hire sysadmin/eng should ask about coming through the door.