Showing results for 
Search instead for 
Did you mean: 
Sign up Log in

TestNG Results with dataProvider

René Habermann
I'm New Here
I'm New Here
Those new to the Atlassian Community have posted less than three times. Give them a warm welcome!
November 1, 2018


it seems the testNG Results parser does not properly recognize tests that are executed through a data provider (or at least not in the way i'd expect).

In example, we have a test that is executed 100 times with different data. For 20 of those cases, the test fails. Bamboo will then show this as 1 failed test containing a single failed instance of this test method and one successful test. This omits both the 19 other failed tests and the 79 other successful tests, so i need to rely on the html report completely. I suspect this has to do with each of the 100 tests named exactly the same (as usual with data provider).

Is anyone familiar with this? Is this the intended state? Does anyone know how to display (in this case) all 100 test results in the frontend, instead of only one or two?

1 answer

0 votes
Chris Berry
Atlassian Team
Atlassian Team members are employees working across the company in a wide variety of roles.
November 1, 2018

Hi René.

Yes, this relates to BAM-17738. We parse the xml file and record success or failure for a specific test using the "name" field as the identifier. I believe in your case the "name" for all your test cases are identical and hence Bamboo only displays the one entry.

I've added this community entry to the bug to help raise its visibility with the developers.




Atlassian support - Bamboo

Suggest an answer

Log in or Sign up to answer
AUG Leaders

Atlassian Community Events