The Atlassian Community Forums are currently in read-only mode. We will be relaunching on a new platform on September 22 (read more here). We apologize for the extended downtime. For concerns or questions, please email communitymanagers@atlassian.com. See you on the other side, on the new Atlassian Community Forums! :)

×

Forums

Articles
Create
cancel
Showing results for 
Search instead for 
Did you mean: 

Failed test in pipeline treated as non-failed

Vladimir Klekovkin
I'm New Here
I'm New Here
Those new to the Atlassian Community have posted less than three times. Give them a warm welcome!
November 22, 2020

I'm using restcli tool (https://github.com/restcli/restcli) - command-line test tool for HTTP testing in bitbucket pipelines.

It produces test results in JUnit format, but suddenly bitbucket pipeline captures all tests as successful.

Here example of a test result:

<?xml version="1.0" encoding="UTF-8"?>
<testsuites tests="2" name="IntelliJ Rest CLI - Test Generator">
<testsuite tests="1" name="https://bitbucket.org/"><testcase name="Request executed successfully"/>
</testsuite><testsuite tests="1" name="https://api.bitbucket.org/notexist"> <testcase name="Request executed successfully">
<failure type="AssertionFailure">Response status is not 200

File: example.http
Line: 14</failure>
</testcase>
</testsuite></testsuites>

It treated as successful but clearly contains one failure.

Also, I created PoC repo with pipeline execution:
https://bitbucket.org/vladklekovkin/tests/addon/pipelines/home#!/results/6/steps/%7Bb3c8f9e3-a1d0-4d73-a042-a1ca8f794fc2%7D

0 answers

Comments for this post are closed

Community moderators have prevented the ability to post new answers.

TAGS
AUG Leaders

Atlassian Community Events