News for hackers. Stuff that matters.

Show HN: Flakytest.dev – Improve your flaky test handling process

https://flakytest.dev

I made flakytest.dev because I was frustrated with how teams usually handle CI failures due to flaky test (in my experience it's often a manual process).

The core feature is a one-click way to mute a randomly failing test. Muting is different than skipping a test because a muted test will still run on CI, but it won't fail the entire build if it fails. Keeping a flaky test running in your CI is usually valuable so that you gather more data about it and that your error logs stay relevant.

It only works with pytest for now, but I'll add support for other test frameworks if there is any interest!

( 3 comments | 3 points | on HN )
Re:Show HN: Flakytest.dev – Improve your flaky test handling... by fruktmix on Friday January 12, 2024 @08:00PM (#38976283)
I did my thesis in flaky tests, it's such a neglected area in ci/cd. Good too see people are doing something against it.
Re:Show HN: Flakytest.dev – Improve your flaky test handling... by anze3db on Saturday January 13, 2024 @10:14AM (#38980652)
I'd love to read your thesis! If it's possible please send a link :)
Re:Show HN: Flakytest.dev – Improve your flaky test handling... by fruktmix on Wednesday January 17, 2024 @04:17AM (#39025327)
You can find it if you browse: "Non-deterministic tests and where to find them". I def think we should connect! Just sent ya a request on LinkedIn :)