We have created in our project many different Test cases. These test cases can be understood as a module where tests executed in a specific chain can be considered as a test scenario. That means a specific test is used in different scenarios. In a seccond step we have created a bunch of test executions each having a number of test cases. As an example in a shopping flow the login is represented in a test cases and this test case is part of each flow, means it is assigned to each test execution. The issue we are facing is that we do not find a way to visualize in a dasboard the status of a group of test executions. Let say we have a bunch of test executions. The first 5 belong to user storie 1 and the next 5 to the second US.
Reporting about the individual test execution could be realised in e.g. the Gadget filter results with the column "Test execution Status". However we do not find a possibility to report about the test execution status of a group of test executions. The test cases assigned to several test executions are counted only once. Much wors lets say US 2 did not have started the test execution, the related Overall Test Result Pie Chart is showing progress, because some test cases which have been executed with US 1 and are also part of US 2 test executions are shown as passed or failled, whereas the individual test execution is showing 0 progress.
We need a possibility to show the overall test execution status of a group of test execution.
We tried also to put the test executions into a test plan, however the result is the same. The test executions are broken down into the used test cases and the progress shown is the sum over the test cases and not the sum of test executions.
Someone any idea how to realize that?
Please check here all the information about our Xray Gadgets available, how you can work with them, and which information you will see.
Additionally, please check here all the information about other features regarding reporting.
If you need more help, please contact us directly in our Service Desk and we will be happy to help you further.
Best Regards,
Sérgio Freire,
Solution Architect and Testing Advocate @Xray
Personal blog on testing, Agile and software development: https://sergiofreire.com
Follow me on Twitter: https://twitter.com/darktelecom
I see you have test run summary, can you not add a feature to allow us to view this as a pie chart? it would be much easier to read.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
It is best to contact Xray Support (http://xraysupport.getxray.app) to share your use case to analyze it as a possible improvement feature.
Thank you.
Kind regards,
Rogério Paiva [Xray Support Team]
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Hi @Zoltan Lebanov ,
we have the same issue as we use a very similar procedure: Test Plan whith Test Executions which contain shared Tests.
None of the options from the xray documentation can show us what we need to see: Each Test Execution grouped by status of contained Tests by issue count and percentage.
@Rogério Paiva - Xray Xporter @Sergio Freire - Xblend is there a new gadget app we could use which can report xray content?
Thank you for sharing!
Kind regards.
Paulina
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Did you find the solutions for creating dashboards for Test Plan with Test Executions which contain shared Tests.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.