Hello everyone,
We have an XRay project setup with several custom statuses that, when selected as a result of a Test Step, they are currently overwriting the Overall Test Status; we would like to know if it is possible to customize this setting for each Custom Status to have some of them maintain this behavior and some of them not have it (aka, if we have Pass and another Custom Status for the two test steps, the overall status should be Pass).
Thank you in advance for your time.
Hi @Razvan Grigorescu , we3lcome to the Atlassian Community!
Xray provides multiple statuses. For test steps, these statuses reflect the results of actions taken in a given step. It's generally a good practice to keep it simple (1/0) makes results easier to understand. However, you can add more statuses and assign them meaning, such as "skipping" or "out of scope."
For test execution statuses, there are two additional settings: "final" (indicating that the test has finished with a given outcome) and "Test Coverage Status" (mapping to one of five possible values). Check out the documentation for more: https://docs.getxray.app/display/XRAYCLOUD/Global+Settings%3A+Test+Step+Statuses
The calculated test coverage status depends on the combination of settings and test step statuses. You can get one of five possible outcomes: OK, NOK, NOTRUN, UNKNOWN, or UNCOVERED. For more details, see: https://docs.getxray.app/display/XRAYCLOUD/Understanding+the+calculation+of+coverage+status+and+the+status+of+Tests
Basically, it depends on how you want to map certain statuses and how you want them to appear in test coverage.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.