Create
cancel
Showing results for 
Search instead for 
Did you mean: 
Sign up Log in

Failed test in pipeline treated as non-failed

Vladimir Klekovkin November 22, 2020

I'm using restcli tool (https://github.com/restcli/restcli) - command-line test tool for HTTP testing in bitbucket pipelines.

It produces test results in JUnit format, but suddenly bitbucket pipeline captures all tests as successful.

Here example of a test result:

<?xml version="1.0" encoding="UTF-8"?>
<testsuites tests="2" name="IntelliJ Rest CLI - Test Generator">
<testsuite tests="1" name="https://bitbucket.org/"><testcase name="Request executed successfully"/>
</testsuite><testsuite tests="1" name="https://api.bitbucket.org/notexist"> <testcase name="Request executed successfully">
<failure type="AssertionFailure">Response status is not 200

File: example.http
Line: 14</failure>
</testcase>
</testsuite></testsuites>

It treated as successful but clearly contains one failure.

Also, I created PoC repo with pipeline execution:
https://bitbucket.org/vladklekovkin/tests/addon/pipelines/home#!/results/6/steps/%7Bb3c8f9e3-a1d0-4d73-a042-a1ca8f794fc2%7D

0 answers

Suggest an answer

Log in or Sign up to answer
TAGS
AUG Leaders

Atlassian Community Events