I am trying to implement an automatic testing solution based on Xray. I export Cucumber tests (from test execution plan), run it in a Java / maven / junit / selenium solution. Then integrate the result using the "Import Execution result" button.
For the moment I have managed to export the test(s) form Xray, run the test(s) in my framework and generate a JSON file.
But the JSON file don't looks to pleased Xray. The problem is that I don't have access to logs, so I don't know what is wrong.
I have check all topics I have found without success.
I have even maid a manual json file based on this related article : https://docs.getxray.app/display/XRAYCLOUD/Import+Execution+Results+-+REST#ImportExecutionResultsREST-XrayJSONresults
But I the file don't work.
When the integration works, I have a message "Mismatched Result and Scenario" but all the lines of the test have been integrated and have a correct status.
According to Xray support, we should use the "standard cucumber output". Apparently or an update is perturbing this comment, or the solution haven't been tested.
I have contacted the support of Xray, but they take time to answer.
So if you have any suggestions, configuration, documentation, I will be pleased to read it.
Hi @Vincent Goguet ,
Your request for help was not sent directly to the support team using the support service desk portal (http://xraysupport.xpand-it.com). It is always best to contact the support directly through the portal so that the team receives the request right away.
Also, it is important to let you know that we have replied within the Standard Support Service, which is open during business hours, from 10 am to 7 pm CET (Central Europe Time), Monday through Friday.
If you need 24x7 support, we advise upgrading to the Premium support offer.
And once the support team got your request, it was resolved in a couple of days.
Rogério Paiva [Xray Support Team]
Thank you for your help, I had a lot of different problems to fix.
Ana Teixira form support team took the time to explain me and guide me to a working solution.
For the community: the majority of my problems were, in fact, related to the writing of Cucumber tests in Xray (installed on a Jira cloud solution). For example, Scenario and Scenario Outline keywords must not be written in the text area. Xray figure by itself if it is facing a Scenario Outline and write the correct keyword in the export file.
I was confused because my framework was leading the test correctly and getting a correct result. But generate an understandable json file for Xray.
So, thank to Ana and the support team.
On behalf of everyone at the Xray Support Team, I wanted to thank you very much for your kind words.
Providing great products and support is our primary goal, and knowing that you appreciate our efforts helps keep us motivated.
Please feel free to contact us through our Service Desk portal (http://xraysupport.xpand-it.com) whenever you need our assistance.
Rogério Paiva [Xray Support Team]
Happy New Year, everybody! What better way to kick off 2022 than with a new Marketplace Partner Spotlight ✨ This month, we're getting to know Daniel Franz, co-founder of Fine Software. Fine Software ...
Connect with like-minded Atlassian users at free events near you!Find an event
Connect with like-minded Atlassian users at free events near you!
Unfortunately there are no Community Events near you at the moment.Host an event
You're one step closer to meeting fellow Atlassian users at your local event. Learn more about Community Events