SREBench Competition

Re:SREBench Competition by dgl on Thursday August 15, 2024 @10:27PM (#41262584)

Not sure whether there's lots of people trying out commands right now (is it backed by a real k8s cluster?), but some commands are taking over 10 seconds to run. Not really a fair "benchmark" when the system's speed is variable.

I also only got "partially_correct" for some, not sure whether it wanted more detail or just didn't like how I phrased things. Neat though.

                      Success Rate        MTTR (Mean time to Resolution)
  YOU:                50.00 %              1.80 min
  PARITY AI SRE:      70 %                 2 min

At least I'm faster than an AI?

[ Parent | on HN ]

Re:SREBench Competition by jtsaw on Thursday August 15, 2024 @10:32PM (#41262601)

hmmm, not sure where the latency is coming from, might need to up the resources.

[ Parent | on HN ]

Re:SREBench Competition by dgl on Thursday August 15, 2024 @10:38PM (#41262650)

Maybe the AI can work it out?

More seriously usually issues where the observed behaviour is "the system is slow" are harder to root cause than complete outages. It depends partly how good your capacity planning is obviously, but maybe an AI could help with that too.

[ Parent | on HN ]

Re:SREBench Competition by thinkmassive on Friday August 16, 2024 @09:22AM (#41266199)

If only there were a software engineering discipline that focused on these types of issues /s

[ Parent | on HN ]