How to deal with one test that applies to multiple applications

Question

Hi everyone!

So I have a situation that has to have a solution using Jira and XRay, but I haven't been able to find it.

In my company, I have one product, with three applications. And I have one test case that applies to all three applications.

At the moment, we are creating 3 test issues (one for each application) and executing them in one test execution (same code level for all three applications). So if the test fails in one application, it's easy to spot which application has an error because we have one test per application.

However, we are thinking this method can be simplified using Jira and Xray features, we just don't know how. Because this way I can have a million test issues, all having the same steps and outputs, just to indicate it applies to several applications.

Is there a way to manage this scenario using Jira and/or Xray features?

Is it possible to mirror this scenario using only just one test issue? And still have a clear execution and perception of which application fails that one test case?

(Please do not mistake this with test versions or product versions ;)  That part we have it figured out)

Thank you so much for helping.

Rogério Paiva - Xray Xporter · Answer

Hi @Cláudia Dias

I would advise using Test Environments, where each Application is a different environment.

This way, you can separate the Test by the environment and know which Application the results belong to.

Also, with the Test Environments, the Test will only PASS if it has passed in all environments, which can be useful. For instance, if a Test has passed on two Applications and failed in the third one, you can spot something wrong by looking a the Test status.

Then you can investigate which environment has failed since Xray provides a Test Environment filter in several locations (reports, etc.).

Please our documentation page about working with Test Environments.

Any additional questions, please get in touch with Xray Support (http://xraysupport.getxray.app); we would gladly assist you.

Thank you.

Kind regards,
Rogério Paiva [Xray Support Team]

Fabian Lim · Answer

Hi @Cláudia Dias

Yes, you should be able to replicate what you need.

At the highest hierarchy you would be creating test plans for each application separately and then you can choose which test cases you want to execute. The test plans can have a field to differentiate between the apps. Each will have their own execution for the same test case.

I hope this helps.