How to find tests that have never been added to a test cycle?

Question

I have 175 QA Engineers and through random audit I have found completed test cases that appear to have never made it into a test cycle.  In other words, I can scroll to the bottom of a test to the "Test Executions" section and it is empty.  I use JIRA in the Cloud and the Zephyr plugin.  I have read countless posts about "testsWithoutExecution()" and other approaches, but I have yet to find one that actually works.  Seems like it would be basic functionality to have.

Jui Shah_9qc86d · Answer

This is not working for me. Is there any solution for the latest version?

Irene Horvat · Answer

Hopefully my answer helps someone.

I initially didn't succeed similar to the author of this thread, but did manage to get the query to work and return tests that had not been added to an execution.  I found the problem to be resolved using the following syntax:

issue in testsWithoutExecution(WCX3A)

where WCX3A is the project key.

It did take a little trial and error to get the syntax right, and I have jql extensions installed.

Note: The search is in the jira issues advance search, and not the zephyr execution search window.

Jimmy Seddon · Answer

Hey Kev,

I took a quick look myself and if you look at the question asked here:

https://community.atlassian.com/t5/Answers-Developer-Questions/Tests-not-in-a-Test-Cycle/qaq-p/485323

It mentions that the 'Search Test Executions' function only recognizes ZQL for the queries.

One of the further suggested solutions mentions:

Under Tests/Search Tests use the following (substitute Project Name with your project):  The resultant list of issues are tests that have never been present in an execution.

issue in testsWithoutExecution() and project = "Project Name"

I'm willing to bet that the issue you are having is that the 'testsWithoutExecution()' is a Zephyr specific "ZQL" function and is not recognized in the standard JQL issue search.

Can you try as the other suggested solution recommends and use the Zephyr Search Tests server dialog to see if that yields more desireable results?

-Jimmy