Test Analytics

Flaky tests are rage-inducing – especially when you know that flaky test could pass the next time you run it, or could take another 3 tries.

Codecov Test Analytics separates flaky tests from legitimate failures, and calls them out in the PR comment so you know which tests to re-run locally or skip, and which ones mean your code needs to be fixed.

Simply grab the offending test name from the PR comment and re-run it locally, or at worst re-run your CI, but this time with confidence.

Flaky test detection is included in Pro and Enterprise plans for private repos, and in all plans for public and open source repos.

Digging through CI logs to determine which lines caused test failures is painful. Test Analytics puts an end to that nonsense.

Failed tests are listed in a PR comment, showing which lines failed which tests, so you can start fixing your code right away. The included copy-and-pasteable stack trace makes it easy to get started.

Dealing with failing and flaky tests in the moment is one thing, but you need to address recurring test suite problems. Over time they can slow down your CI, and cause costly re-runs that can frustrate your developers.

Codecov keeps track of test suite statistics that help you prioritize exactly which tests are causing the most havoc.

• Total test suite run time, slowest tests callout, and last test duration let you zero in on the tests that are dragging your CI performance down.
• Flaky test count, failed test count, average and individual failure and flake rates make it clear which tests are flaking the most, so you can fix them first.

Want to test the waters before signing up? Codecov’s Basic Test Results GitHub Action gives you just the essentials—test failures and a stack trace in your PR for faster debugging.