Create
cancel
Showing results for 
Search instead for 
Did you mean: 
Sign up Log in
Celebration

Earn badges and make progress

You're on your way to the next level! Join the Kudos program to earn points and save your progress.

Deleted user Avatar
Deleted user

Level 1: Seed

25 / 150 points

Next: Root

Avatar

1 badge earned

Collect

Participate in fun challenges

Challenges come and go, but your rewards stay with you. Do more to earn more!

Challenges
Coins

Gift kudos to your peers

What goes around comes around! Share the love by gifting kudos to your peers.

Recognition
Ribbon

Rise up in the ranks

Keep earning points to reach the top of the leaderboard. It resets every quarter so you always have a chance!

Leaderboard

Come for the products,
stay for the community

The Atlassian Community can help you and your team get more value out of Atlassian products and practices.

Atlassian Community about banner
4,464,354
Community Members
 
Community Events
176
Community Groups

Xray JSON - How to import execution result

Edited

Hello,

 

I am trying to implement an automatic testing solution based on Xray. I export Cucumber tests (from test execution plan), run it in a Java / maven / junit / selenium solution. Then integrate the result using the "Import Execution result" button.

 

For the moment I have managed to export the test(s) form Xray, run the test(s) in my framework and generate a JSON file.

 

But the JSON file don't looks to pleased Xray. The problem is that I don't have access to logs, so I don't know what is wrong.

 

I have check all topics I have found without success.

I have even maid a manual json file based on this related article : https://docs.getxray.app/display/XRAYCLOUD/Import+Execution+Results+-+REST#ImportExecutionResultsREST-XrayJSONresults

But I the file don't work.

When the integration works, I have a message "Mismatched Result and Scenario" but all the lines of the test have been integrated and have a correct status.  

 

According to Xray support, we should use the "standard cucumber output". Apparently or an update is perturbing this comment, or the solution haven't been tested.

 

I have contacted the support of Xray, but they take time to answer.

So if you have any suggestions, configuration, documentation, I will be pleased to read it.

 

Best regards;

1 answer

Hi @Vincent Goguet ,

Your request for help was not sent directly to the support team using the support service desk portal (http://xraysupport.xpand-it.com). It is always best to contact the support directly through the portal so that the team receives the request right away.

Also, it is important to let you know that we have replied within the Standard Support Service, which is open during business hours, from 10 am to 7 pm CET (Central Europe Time), Monday through Friday.
If you need 24x7 support, we advise upgrading to the Premium support offer.


And once the support team got your request, it was resolved in a couple of days.

Kind regards,
Rogério Paiva [Xray Support Team]

Yes,

Thank you for your help, I had a lot of different problems to fix.

Ana Teixira form support team took the time to explain me and guide me to a working solution.

For the community: the majority of my problems were, in fact, related to the writing of Cucumber tests in Xray (installed on a Jira cloud solution). For example, Scenario and Scenario Outline keywords must not be written in the text area. Xray figure by itself if it is facing a Scenario Outline and write the correct keyword in the export file.

I was confused because my framework was leading the test correctly and getting a correct result. But generate an understandable json file for Xray. 

 

So, thank to Ana and the support team.

Best regards;

Hi @Vincent Goguet 

On behalf of everyone at the Xray Support Team, I wanted to thank you very much for your kind words.

Providing great products and support is our primary goal, and knowing that you appreciate our efforts helps keep us motivated.

Please feel free to contact us through our Service Desk portal (http://xraysupport.xpand-it.com) whenever you need our assistance.

Thank you.
Kind regards,
Rogério Paiva [Xray Support Team]

Suggest an answer

Log in or Sign up to answer
TAGS

Atlassian Community Events