How to filter test cases that have never failed historical test runs?

Question

Hi JIRA gods,

I need some help on filtering all test cases that have never failed in the historical test runs.

My goal is to reduce the number of test cases that did not find bugs, so i plan to display them in batches first.

Our project did not purchase any add-on related to this, so I can only try to use the native jira tool to solve it. I tried Query filter and Xray reports, but none of them succeed :(

Manuel_u1i996 · Answer

Hi @Yu Ke (York) ,

you can indeed use something like the following JQL (full list of JQL functions here).

issue in testPlanTests(xxxx) AND issue not in testExecutionTests(xxxx,"FAIL")

However, that is only available if you have Xray for Jira server/dc.

If you have Xray for Jira cloud, assuming that's the case considering the tags on this question, then it's harder to achieve as for cloud there are no JQL functions, just some basic filtering possibilities as detailed here.

One workaround would be to  use the Tests Runs List report and filter by the test runs that passed, todo, executing.. and then export it to CSV.. but it would require some work to get exactly what you need; there's no straightforward solution.

Yu Ke (York) · Answer

OKay i think i've got the answer from a friend.

I did it with this Query:

issue in testPlanTests(xxxx) AND issue not in testExecutionTests(xxxx,"FAIL|OKBUT")

reference: https://docs.getxray.app/pages/viewpage.action?pageId=46885446#EnhancedqueryingwithJQL-JQLFunctions