We’re evaluating Xray plugin as a way to get better visibility in our projects linking between features on one side and tests on another. We did install Jenkins plugin, configured JIRA and “Test Connection” is successful. As a prototype we took an existing Java project with Cucumber tests. On JIRA side we had a project where we manage requirements. So we added another JIRA project using Xray template. Suppose its ID is XRAY and issues have IDs like XRAY-1. In the source tree we manage Cucumber features under src/test/resources/features/**/*.feature. Those feature files usually combine several tests for each feature. We created a new ticket of type test in XRAY project so its ID is XRAY-1. We put it in the feature running this test like
Scenario Outline: Get catalog
While other tests in the same feature might have other tags (we were trying to use Zephyr previously). We are able to execute the test running job correctly. It generates Cucumber report in target/json/cucumber.json. We can see the test with the new tag XRAY-1 in a published report. But when we try to enable Xray: Results Import Task we get
ERROR: Step ‘Xray: Results Import Task’ failed: Unable to confirm Result of the upload..... Upload Failed! Status:400 Response:No tests found in execution result
So, what we’re doing wrong?
With best regards,
Well, the problem was and we figured it out by now that we used @issue:XRAY-1 similarly to Zephyr. When switching to @XRAY-1, providing that we had Xray test with XRAY-1 ID in JIRA, it resolved the problem. So the problem was how Jenkins plugin parses the report. It could be that the schema could be extended to support more flexible tagging but we're not there yet and it is beyond the basic prototyping we're performing.
Only One test execution imported in Jira via Jenkin.
Scenario Outline: Valid City Search
Given User navigate to openWeatherMap url <URL>
Then openWeatherMap page is displayed
When User enters vaild city <city>
When User clicks on search button
Then website successfully returns weather details for the city
This Test Cases is exported from Jira xray, running two times. But after importing back to jira. Only One result is displayed
Connect with like-minded Atlassian users at free events near you!Find a group
Connect with like-minded Atlassian users at free events near you!
Unfortunately there are no AUG chapters near you at the moment.Start an AUG