Xcode and Bamboo | XCTest false positives

I have 7 XCTest targets in Xcode. When run locally they all pass.

When run via Bamboo agent (same system that passed local run) around 2-4% of the test cases will randomly fail and they differ from run to run.

All of the failed test cases failed with duration < 1 sec.

Has anyone else experienced this? If so, do you know of any solutions?

1 answer

Community moderators have prevented the ability to post new answers.

0 votes

Hi David! How are you doing?

I have seen this behavior when the tests had time execution constraints in their Asserts. For example, a call would take no more than 100ms.

Is this your case?

Thanks,

Cristiano

You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.

Hi Cristiano, I checked and confirmed that was not the case.
I dug in to the log and it appears all are failing due to

"App state is still not running active, state = XCApplicationStateRunningInactive"

Reading up on how to resolve this issue.

You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.