XRay test execution question

Question

Just for understanding the flow Test execution.

Below is step which is performed

* Added two case in repository
* Added a those 2 test case in a story 
* created test execution and run the test make both test case passed and complete the test execution  and then it shows test test result passed .
* Now added same 2 test case in another story  as soon as i added test case it says test case is passed  but i created new test execution make both test case failed and complete the execution . 
* Now both story says as failed status.   How I show the execution status  only for that story

Stefan Salzl · Answer

Hi @Amit Srivastava

Any feedback to this ?

Best
Stefan

Andreas_u5cog9 · Answer

As mentioned by @Stefan Salzl, if the exact same Test passes for one story, but fails for another, I think, either the Test design is not correct or the scope changed.

To solve this, I would start using different test environments or even better, different versions. So if you ship US1 within FixVersion 1.0 and execute this with FixVersion 1.0, a second test execution with FixVersion 2.0 will not affect the results of executions with another FixVersion assigned.

To do this, depending on your Xray settings you may have to change to coverage/ Xray custom field settings.

Best regards

Andreas

Stefan Salzl · Answer

Hi @Amit Srivastava and welcome to the community,

a test case is the description of how a certain functionality/requirement is tested. A test execution then refers to the test case and shows the most recent status.

If the test case REALLY covers both stories then both stories would fail in the test. How could 1 story be passed and 1 failed with exactly the same testing procedure?

Best
Stefan