Xcode and Bamboo | XCTest false positives

I have 7 XCTest targets in Xcode. When run locally they all pass.

When run via Bamboo agent (same system that passed local run) around 2-4% of the test cases will randomly fail and they differ from run to run. 

All of the failed test cases failed with duration < 1 sec.

Has anyone else experienced this? If so, do you know of any solutions?

1 answer

0 vote
Cristiano Oliveira Community Champion Jun 06, 2017

Hi David! How are you doing?

I have seen this behavior when the tests had time execution constraints in their Asserts. For example, a call would take no more than 100ms.

Is this your case?

Thanks,

Cristiano

Hi Cristiano, I checked and confirmed that was not the case.
I dug in to the log and it appears all are failing due to

"App state is still not running active, state = XCApplicationStateRunningInactive"

Reading up on how to resolve this issue. 

Suggest an answer

Log in or Sign up to answer
How to earn badges on the Atlassian Community

How to earn badges on the Atlassian Community

Badges are a great way to show off community activity, whether you’re a newbie or a Champion.

Learn more
Community showcase
Published May 18, 2017 in Bamboo

FAQ: How to Upgrade Bamboo Server

Bamboo 5.9 will no longer be supported after June 12, 2017. What does this mean? As part of our End of Life policy, Atlassian supports major versions for two years after the first major iteratio...

1,575 views 0 6
Read article

Atlassian User Groups

Connect with like-minded Atlassian users at free events near you!

Find a group

Connect with like-minded Atlassian users at free events near you!

Find my local user group

Unfortunately there are no AUG chapters near you at the moment.

Start an AUG

You're one step closer to meeting fellow Atlassian users at your local meet up. Learn more about AUGs

Groups near you