Xray for Java-Cucumber + Jenkins

Hello.

We’re evaluating Xray plugin as a way to get better visibility in our projects linking between features on one side and tests on another. We did install Jenkins plugin, configured JIRA and “Test Connection” is successful.  As a prototype we took an existing Java project with Cucumber tests. On JIRA side we had a project where we manage requirements. So we added another JIRA project using Xray template. Suppose its ID is XRAY and issues have IDs like XRAY-1. In the source tree we manage Cucumber features under src/test/resources/features/**/*.feature. Those feature files usually combine several tests for each feature. We created a new ticket of type test in XRAY project so its ID is XRAY-1. We put it in the feature running this test like

@get_catalo
@permission
@issue:XRAY-1
Scenario Outline: Get catalog

While other tests in the same feature might have other tags (we were trying to use Zephyr previously). We are able to execute the test running job correctly. It generates Cucumber report in target/json/cucumber.json. We can see the test with the new tag XRAY-1 in a published report. But when we try to enable Xray: Results Import Task we get

ERROR: Step ‘Xray: Results Import Task’ failed: Unable to confirm Result of the upload..... Upload Failed! Status:400 Response:No tests found in execution result

So, what we’re doing wrong?

Thanks.

With best regards,

David.

3 answers

Hi David,

This situation is described here in the Common problems section. Most probably you're trying to submit a Cucumber JSON results file without having previously created the Cucumber Tests.

To work with cucumber you need to follow this procedure.

 

Best regards,

Xpand Add-ons Team

Well, the problem was and we figured it out by now that we used @issue:XRAY-1 similarly to Zephyr. When switching to @XRAY-1, providing that we had Xray test with XRAY-1 ID in JIRA, it resolved the problem. So the problem was how Jenkins plugin parses the report. It could be that the schema could be extended to support more flexible tagging but we're not there yet and it is beyond the basic prototyping we're performing.

0 votes

Hi David,

Can you please explain to me how you do for the configuration of jenkins for execute test and view it in jira thanks 

Only One test execution imported in Jira via Jenkin.

 

@Scenario2
Scenario Outline: Valid City Search
Given User navigate to openWeatherMap url <URL>
Then openWeatherMap page is displayed
When User enters vaild city <city>
When User clicks on search button
Then website successfully returns weather details for the city

Examples:
| URL | city | resultcount |
| https://openweathermap.org/ | Mumbai | 1 |
| https://openweathermap.org/ | Lon | 5 |

 

This Test Cases is exported from Jira xray, running two times. But after importing back to jira. Only One result is displayed

Suggest an answer

Log in or Sign up to answer
Community showcase
Published Mar 14, 2019 in Jira

Updates to jira.atlassian.com give you visibility into what's coming in Jira Server and Data Center

Hello, Community! My name is Gosia and I'm a Product Manager on Jira Server and Data Center here at Atlassian. Since 2002 when we launched our public issue tracker, jira.atlass...

658 views 1 15
Read article

Atlassian User Groups

Connect with like-minded Atlassian users at free events near you!

Find a group

Connect with like-minded Atlassian users at free events near you!

Find my local user group

Unfortunately there are no AUG chapters near you at the moment.

Start an AUG

You're one step closer to meeting fellow Atlassian users at your local meet up. Learn more about AUGs

Groups near you