Flaky test detection for CI

PASS FAIL PASS We catch the flip.

Falsky watches every CI run, spots tests flipping between pass and fail, and quarantines them — so real bugs block merges and phantom failures don't.

github actions · pytest · jest · jUnit XML
run #4821 · main · 5 testsLIVE
BUILD ——
▲ pay/webhook quarantined → issue #231 · merge unblocked
01 The catch
STEP 01

Watch

Every run is recorded — result, retry count and timing for each test. Falsky's GitHub Action reads your JUnit XML output automatically.

STEP 02

Weigh

A Bayesian trust score weighs pass-rate, retries and timing variance to separate flaky from genuinely broken. Better than naive pass/total.

STEP 03

Quarantine

Flaky tests leave the merge path with an issue attached. Real bugs stay blocking. Your pipeline stays green.

02 Every run, remembered

48 builds · each tile is one run — green stable, amber flaky, red real failure

03 The numbers
0%

of red builds are actually flaky

0m

engineer time lost per false red

0

agents or code changes needed

FAIL→PASS

Stop the flip-flop.

Five minutes to wire in. Your next red build might not actually be red.

Start detecting — free
free for open source · no card