Test Coverage report (XRay)

Konstantinos Antonakopoulos October 15, 2024

Hello,

I have the following problem. In my project, we have requirements linked to testcases and I am trying to build the Test Coverage report in XRay.

screen.png

In the report, I see that there are 455 requirements with status NOTRUN which means that linked testcases were not executed/or dont have a status.

As I am trying to identify the root cause, and I found out that the testcases shown under the Other category are basically planned for a later release of our product and not for the current one. Those should not be part of the test coverage estimation for the current release.

The testcases under the Other column include the release version in Affects versions field, but how can I exclude them from Test coverage calculation?

Does anyone has any idea how to solve this issue as it creates misleading information to our management.

Thank you in advance.

 

Best,

Konstantinos 

1 answer

0 votes
Manuel
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Leaders.
October 19, 2024

In that report, you have 2 important things that can help you out and they're located at the top of the report:

a) Filter: for defining the data (i.e., the requirements) you want to show on the report

b) Analysis & Scope: how you want to analyze the filtered data that you selected on the Filter

 

Given this, you can approach it in several different ways:

  1. Filter the report to only show requirements "assigned" to the version you want to consider (i.e., the ones that have a Fix Version with the version you're concerned with). Then analyze them considering the results obtained on that version
  2. If you're using Test Plans as a way to define what you test for a given release, sprint,etc, then on the Analysis you can pick that Test Plan as the scope of analysis. That will , as consequence, show some requirements as being uncovered as Xray will consider that they don't have Tests associated (considering the Test Plan used as scope of analysis.

 

  • More info on the Coverage Report here
  • More info on how to perform coverage analysis here

Suggest an answer

Log in or Sign up to answer
DEPLOYMENT TYPE
CLOUD
PRODUCT PLAN
PREMIUM
TAGS
AUG Leaders

Atlassian Community Events