XRAY PLUGIN is not updating Test Tickets if they are failing due to Suite Setup failure

enatrec
I'm New Here
I'm New Here
Those new to the Atlassian Community have posted less than three times. Give them a warm welcome!
January 29, 2025

Hello,

I am running some tests with Robot Framework and updating the JIRA test tickets using XRAY plugin. XRAY is using the output.xml file created by Robot FW to extract the test result.

I have detected that when the Test Suite Setup fails, the tests are marked as FAILED but the XRAY plugin is ignoring them. It seems as they are failing due to the Test Setup fail, XRAY skip them.

But this is very confuse, for example, I have 60 tests, and after running them, the test execution created by XRAY only have 12 tests; if I check the output.xml file, I can see that the other 48 tests have "Parent suite setup failed" in the status. 

Is there any way to configure XRAY to avoid skipping this situation?

Extract of the output.xml:

- test included by XRAY in the test execution JIRA ticket

sc1.png

- test skipped

sc2.png

1 answer

Suggest an answer

Log in or Sign up to answer
0 votes
Francisco Fonseca _Xray_
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Leaders.
February 3, 2025

Hi @enatrec 

Welcome to the community.

I would strongly suggest open a ticket with our support team for help here.

Best, Francisco.

TAGS
AUG Leaders

Atlassian Community Events