Create
cancel
Showing results for 
Search instead for 
Did you mean: 
Sign up Log in
It's not the same without you

Join the community to find out what other Atlassian users are discussing, debating and creating.

Atlassian Community Hero Image Collage

Xray JSON - How to import execution result

Edited

Hello,

 

I am trying to implement an automatic testing solution based on Xray. I export Cucumber tests (from test execution plan), run it in a Java / maven / junit / selenium solution. Then integrate the result using the "Import Execution result" button.

 

For the moment I have managed to export the test(s) form Xray, run the test(s) in my framework and generate a JSON file.

 

But the JSON file don't looks to pleased Xray. The problem is that I don't have access to logs, so I don't know what is wrong.

 

I have check all topics I have found without success.

I have even maid a manual json file based on this related article : https://docs.getxray.app/display/XRAYCLOUD/Import+Execution+Results+-+REST#ImportExecutionResultsREST-XrayJSONresults

But I the file don't work.

When the integration works, I have a message "Mismatched Result and Scenario" but all the lines of the test have been integrated and have a correct status.  

 

According to Xray support, we should use the "standard cucumber output". Apparently or an update is perturbing this comment, or the solution haven't been tested.

 

I have contacted the support of Xray, but they take time to answer.

So if you have any suggestions, configuration, documentation, I will be pleased to read it.

 

Best regards;

1 answer

Hi @Vincent Goguet ,

Your request for help was not sent directly to the support team using the support service desk portal (http://xraysupport.xpand-it.com). It is always best to contact the support directly through the portal so that the team receives the request right away.

Also, it is important to let you know that we have replied within the Standard Support Service, which is open during business hours, from 10 am to 7 pm CET (Central Europe Time), Monday through Friday.
If you need 24x7 support, we advise upgrading to the Premium support offer.


And once the support team got your request, it was resolved in a couple of days.

Kind regards,
Rogério Paiva [Xray Support Team]

Yes,

Thank you for your help, I had a lot of different problems to fix.

Ana Teixira form support team took the time to explain me and guide me to a working solution.

For the community: the majority of my problems were, in fact, related to the writing of Cucumber tests in Xray (installed on a Jira cloud solution). For example, Scenario and Scenario Outline keywords must not be written in the text area. Xray figure by itself if it is facing a Scenario Outline and write the correct keyword in the export file.

I was confused because my framework was leading the test correctly and getting a correct result. But generate an understandable json file for Xray. 

 

So, thank to Ana and the support team.

Best regards;

Hi @Vincent Goguet 

On behalf of everyone at the Xray Support Team, I wanted to thank you very much for your kind words.

Providing great products and support is our primary goal, and knowing that you appreciate our efforts helps keep us motivated.

Please feel free to contact us through our Service Desk portal (http://xraysupport.xpand-it.com) whenever you need our assistance.

Thank you.
Kind regards,
Rogério Paiva [Xray Support Team]

Suggest an answer

Log in or Sign up to answer
TAGS
Community showcase
Published in Apps & Integrations

Marketplace Partner Spotlight: Fine Software

Happy New Year, everybody! What better way to kick off 2022 than with a new Marketplace Partner Spotlight ✨ This month, we're getting to know Daniel Franz, co-founder of Fine Software. Fine Software ...

392 views 2 15
Read article

Community Events

Connect with like-minded Atlassian users at free events near you!

Find an event

Connect with like-minded Atlassian users at free events near you!

Unfortunately there are no Community Events near you at the moment.

Host an event

You're one step closer to meeting fellow Atlassian users at your local event. Learn more about Community Events

Events near you