We built the fastest CI in the world and it failed

Re:We built the fastest CI in the world and it failed by hedora on Tuesday September 12, 2023 @01:00PM (#37484239)

Also, which of my 1,000 test suites are flaky, and when did they start being flaky?

Flamebox almost got this right, but groups by wall-clock instead of git sha:

https://flamebox.sourceforge.net

The screenshot is most of what there is to see. Clicking a test run opens the test log.

Does anyone know of a currently-maintained alternative with a less-bad dashboard?

[ Parent | on HN ]

Re:We built the fastest CI in the world and it failed by Phelinofist on Tuesday September 12, 2023 @03:31PM (#37486680)

That looks really cool, thanks for the link. Something like this well integrated into Jenkins would be super useful.

Our DevOps team build something custom: they check all test logs of all builds of all branches and aggregate all that into a Grafana dashboard. We use it to monitor tests that are failing, to get a better grip on flakiness. Works okay but could be better.

[ Parent | on HN ]