Showing results for 
Search instead for 
Did you mean: 
Sign up Log in
It's not the same without you

Join the community to find out what other Atlassian users are discussing, debating and creating.

Atlassian Community Hero Image Collage

TestNG Results with dataProvider


it seems the testNG Results parser does not properly recognize tests that are executed through a data provider (or at least not in the way i'd expect).

In example, we have a test that is executed 100 times with different data. For 20 of those cases, the test fails. Bamboo will then show this as 1 failed test containing a single failed instance of this test method and one successful test. This omits both the 19 other failed tests and the 79 other successful tests, so i need to rely on the html report completely. I suspect this has to do with each of the 100 tests named exactly the same (as usual with data provider).

Is anyone familiar with this? Is this the intended state? Does anyone know how to display (in this case) all 100 test results in the frontend, instead of only one or two?

1 answer

0 votes
Chris Berry Atlassian Team Nov 01, 2018

Hi René.

Yes, this relates to BAM-17738. We parse the xml file and record success or failure for a specific test using the "name" field as the identifier. I believe in your case the "name" for all your test cases are identical and hence Bamboo only displays the one entry.

I've added this community entry to the bug to help raise its visibility with the developers.




Atlassian support - Bamboo

Suggest an answer

Log in or Sign up to answer
Community showcase
Published in Bamboo

Bamboo Data Center 8.1 is now available

G’day Bamboo customers, Bamboo DC 8.1 is now available with it the following features and programs: SAML 2.0, OpenID Connect, and Crowd SSO In order to help admins with a simplified user manage...

213 views 0 4
Read article

Community Events

Connect with like-minded Atlassian users at free events near you!

Find an event

Connect with like-minded Atlassian users at free events near you!

Unfortunately there are no Community Events near you at the moment.

Host an event

You're one step closer to meeting fellow Atlassian users at your local event. Learn more about Community Events

Events near you