Xray Integration - how do you report on your flaky test cases?

[Darren Whiley]

Hi, 

Xray is great at reporting the current status of a test, I was wondering how people might be using Xray to report on Flaky tests? i.e. identify test cases that have failed in the last 10 test runs but are currently passing

Thanks

D

[Ned Wilbur]

I have also been looking for a way to do this. A simple report that shows all tests and the percent of each status within a timeframe. This is the biggest gap I current have experienced with Xray. All the data is there, I just have not found a way to compile multiple run history/execution reports into a single report such as the one below.

E.g.:

Timeframe: Last 90 days

• TestA: Passed 95% Failed 2%, Skipped 0%, Flaky 3%
• TestB: Passed 99% Failed 1%, Skipped 0%, Flaky 0%
• TestC: Passed 50% Failed 5%, Skipped 0%, Flaky 45%
• ...