We have created in our project many different Test cases. These test cases can be understood as a module where tests executed in a specific chain can be considered as a test scenario. That means a specific test is used in different scenarios. In a seccond step we have created a bunch of test executions each having a number of test cases. As an example in a shopping flow the login is represented in a test cases and this test case is part of each flow, means it is assigned to each test execution. The issue we are facing is that we do not find a way to visualize in a dasboard the status of a group of test executions. Let say we have a bunch of test executions. The first 5 belong to user storie 1 and the next 5 to the second US.
Reporting about the individual test execution could be realised in e.g. the Gadget filter results with the column "Test execution Status". However we do not find a possibility to report about the test execution status of a group of test executions. The test cases assigned to several test executions are counted only once. Much wors lets say US 2 did not have started the test execution, the related Overall Test Result Pie Chart is showing progress, because some test cases which have been executed with US 1 and are also part of US 2 test executions are shown as passed or failled, whereas the individual test execution is showing 0 progress.
We need a possibility to show the overall test execution status of a group of test execution.
We tried also to put the test executions into a test plan, however the result is the same. The test executions are broken down into the used test cases and the progress shown is the sum over the test cases and not the sum of test executions.
Someone any idea how to realize that?
Please check here all the information about our Xray Gadgets available, how you can work with them, and which information you will see.
Additionally, please check here all the information about other features regarding reporting.
If you need more help, please contact us directly in our Service Desk and we will be happy to help you further.
Solution Architect and Testing Advocate @Xray
Personal blog on testing, Agile and software development: https://sergiofreire.com
Follow me on Twitter: https://twitter.com/darktelecom
Hi @Zoltan Lebanov ,
we have the same issue as we use a very similar procedure: Test Plan whith Test Executions which contain shared Tests.
None of the options from the xray documentation can show us what we need to see: Each Test Execution grouped by status of contained Tests by issue count and percentage.
Thank you for sharing!
Connect with like-minded Atlassian users at free events near you!Find an event
Connect with like-minded Atlassian users at free events near you!
Unfortunately there are no Community Events near you at the moment.Host an event
You're one step closer to meeting fellow Atlassian users at your local event. Learn more about Community Events