Same Test with multiple Clients

Question

We are currently working on migrating our old test protocols to JIRA Zephyr and I stumbled across a problem I couldn't find a nice solution for yet.

We are developing a product that also has a webpage that users need to use.

We support multiple browsers (Chrome, Firefox, IE 11 and Safari).

The thing is that when I have a test (e.g. "Registrationprocess") that I want to test in all browsers, I don't want to make a new test for every browser, because the test is always the same, only the plaform changes (same thing with a program I want to test on different Windows versions). If I would just copy/paste the test, then I had to edit every single one of them, when something changes.

What we first thought of was just adding the test multiple times to the same cycle and then just putting the info about the browser into the executions comment (not an ideal solution, but it would at least work).

Then I came across the issue, that you can't add the same test multiple times to the same cycle (https://answers.atlassian.com/questions/257866), which I kind of get, but it makes my life harder.

We also don't want to make a new cycle for every browser, because it just adds unnecessary complexity and kind of breaks the idea of a test cycle.

My question now is how I can have the same test executed in the same cycle, but with different "platforms" (or at least have a nice workaround)

Jeroen Habets · Answer

Is cross browser testing still not supported in 2021?

I also could not find a issue tracker. Does anyone have a ticket?

Rachel2 · Answer

The ability to add tests to multiple devices/browsers, record and report on execution against these various clients is essential and should be added to Zephyr.

It would allow issues of defect clustering to be much more easily identified and to pinpoint areas of risk.

G3 · Answer

Chris...

Here are three simple suggestions for handling your situation in the same test cycle.

* Use Labels
* Use Components

Clone/copy the original 'Test Case' (with all of the steps) and in the summary call it whatever (so you can know to which browser it applies)... ex. "Registration Process (Chrome)", clone "Registration Process (FireFox)", clone " Registration Process (IE 11), clone "Registration Process (Safari)", etc... so you know at a glance to which browser each applies within your cycle.  Also, use the labels field and consistently name each separate test with the browser it tests ("Chrome", "FireFox", "IE11", "Safari").  And/Or, use the components to handle this but requires adding that component to the project.

3 - If you wanted to manage the testing within the same test case (ie. only one Z4J test) - you could clone each step multiple times and somehow identify each cloned/copied/repeated step with the browser it relates to... so step 1-4 would have the same text (maybe)... and maybe the test data field would contain Step 1-Chrome, 2-FireFox, 3-IE11, 4-Safari.  You could also completely handle all the test steps for Chrome first (maybe that's Step 1-11).  Then step 12-22 is the iteration for Firefox.  23-33 is the iteration for IE11.  34-44 for Safari.  A problem would exist if any of the browser steps fail - the whole test case would fail (or be blocked, or WIP, whatever).  BUT when opening the execution you could at least see where all the other browser steps have passed and which step/s are being held up

Other handling methods also come to mind.  Maybe some of the above can inspire your solution.

You've got this covered : -)