Jira/TestRail integration - how to find issues with NO Test Cases

Question

Hi

We have TestRail integrated with Jira (cloud) and can open the TestRail:Cases panel on the Jira tickets to see the linked TestRail test cases. Sometimes when the panel is opened it will say 'No test cases in TestRail are linked to this issue'.

What we would like to do is to identify all issues (in a certain release/version) which have NO test cases.

Is this possible by JQL? I don't think so. Or by API or some other means? Any other ideas or recommendations will be welcome.

I have also asked this question to TestRail support.

Thanks,

Julia

James Woyciesjes · Answer

If you are still looking for a solution...I have not created the final result yet, but you may be able to modify to get what you are looking for by running these two steps and bouncing the data against each other to get info for a dashboard. Note, this is based on Jira Cloud and I am just making calls in the browser, not programmatic yet..

Step 1: TestRail data:

Use the TestRail API to get the list of Test Cases in a given TestRail project that reference Jira issues (have refs):

https://yoursite.testrail.net/index.php?/api/v2/get_cases/entertestrailprojectidhere&suite_id=entertestrailsuiteidhere&limit=250&offset=0

Max return is 250 - iterate using offset=0,250,500,... until no more results.

Step 2: Jira data:

https://yoursite.atlassian.net/rest/api/3/search/jql?jql=project = yourprojectkeyhere AND issuetype = Feature AND statusCategory != Done&fields=key,summary,status&maxResults=100

This uses JQL to set the search parameters. In this case, I limited it to Features with statusCategory != Done. You can add additional fields to retrieve the data but I only want to see Test Case coverage for Features so don't need additional fields.

Max return is 100, iterate using the "nextPageToken". If present, the nextPageToken will be at the bottom of your results page in the browser. To do this, add it after the list of fields...

...&fields=key,summary,status&nextPageToken=pastenextpagetokenhere&maxResults=100

You need to grab the token at the bottom of each set of results and continue until no more results.

Step 3: Combine results:

I have not done this yet, but my next step is to make a list of the Jira keys from the Jira data and look them up in the TestRail data References field to find which have Test Cases and which don't. This will let me know my coverage.

I will probably have a Forge macro created to do this and display the data in Confluence or try PowerBI. In the meantime, for a very manual effort this would get to the end result, I think.

TestRail and Jira Cloud JSON snapshots:

Meredith Bird_xebv33 · Answer

I'm looking for the same as well.

Oriol Ortiz · Answer

Hi Julia and Annelotte,

Do you have any update on that? Some of you would be able to see listed all the tickets that are not linked to any test case?

Someone knows how could we do it?

Thank you,

Oriol