Test execution progress report (X-Ray)

[J]

We can not get the progress report we want from x-ray.

We have multiple test executions, some of which are the same tests but for different equipment.

When we report for the test plan it only gives us the latest result for a test; hiding the execution of a test but for another equipment/configuration/equipment.

We need a complete picture of our test runs for our executions for one specific Jira epic.

It needs to be simple for a project manager.

How can we prevent x-ray from associating multiple test runs from different executions as the same test?

When we update our tests we like that it offers to update all our executions because its the same test but for different platforms/equipment's.

Kind Regards

-J

[Rogério Paiva - Xray Xporter]

Hi @J 

The status of a Test is calculated based on the latest Test Execution status.

However, when using different contexts to run a test, you should use Test Environments.

When using Test Environments, you can "group" the Test Executions by Environments and analyze the results based on each Environment.

Also, the final result is based on the latest Test Execution, but for each Environment.

For instance, if you have a Test run on an Android phone and the same Test run on an iPhone, the Test is only considered PASS if it has passed on both environments.

Because the results of all environments are taken into account for the final Test status calculation.

Please check this documentation page about working in Test environments:

Datacenter doc: https://docs.getxray.app/display/XRAY/Working+with+Test+Environments

Cloud doc: https://docs.getxray.app/display/XRAYCLOUD/Working+with+Test+Environments

Please get in touch with Xray Support (http://xraysupport.getxray.app); if you need additional help on this matter, we would gladly assist you.

Thank you.

Kind regards,
Rogério Paiva [Xray Support Team]