Unexplained pauses between Bamboo plan runs growing over time

Over time, we're seeing longer and longer pauses between Bamboo plan runs, to the point that they're not keeping up with demand.  In our scenario, a small plan runs on a remote agent once for each Perforce check-in, acting like a pre-processor for other build plans, at a rate of a few check-ins per minute, occasionally up to 20 check-ins per minute.  The duration of our jobs in the plan is about 8 to 10 seconds, so they do queue up when there are bursts of check-ins.  But the problem is over time, thousands of builds, there's a growing pause between plan runs, and even within jobs of the plan.  Eventually it's only running once per couple minutes, and at that pace, it's not keeping up with an ever-growing queue of check-ins.  Restarting the server (5.4.1) seems to help, but the pauses eventually come back.  Any ideas?  

With debug logging on the server and remote agent during the slowed builds, the agent is just sitting idle waiting for the server, and the server isn't working on anything either.  We see a number of Quartz jobs starting and expiring, and message consumers polling for messages:

2015-02-10 11:28:46,919 DEBUG [bambooAgentMessageListenerConnector-1] [FingerprintMatchingMessageListenerContainer] Consumer [PooledMessageConsumer { ActiveMQMessageConsumer { value=ID:remoteagent.ourcompany.com-39415-1423368652369-3:1:1:1, started=true } }] of session [PooledSession { ActiveMQSession {id=ID:remoteagent.ourcompany.com-39415-1423368652369-3:1:1,started=true} }] did not receive a message

 

 

1 answer

0 vote

General rules are:

  • upgrade to most recent version (5.7.2)
  • bump memory settings

If that won't help contact our Support

 

Suggest an answer

Log in or Sign up to answer
Atlassian Community Anniversary

Happy Anniversary, Atlassian Community!

This community is celebrating its one-year anniversary and Atlassian co-founder Mike Cannon-Brookes has all the feels.

Read more
Community showcase
Renan Battaglin
Published May 18, 2017 in Bamboo

FAQ: How to Upgrade Bamboo Server

Bamboo 5.9 will no longer be supported after June 12, 2017. What does this mean? As part of our End of Life policy, Atlassian supports major versions for two years after the first major iteratio...

1,493 views 0 5
Read article

Atlassian User Groups

Connect with like-minded Atlassian users at free events near you!

Find a group

Connect with like-minded Atlassian users at free events near you!

Find my local user group

Unfortunately there are no AUG chapters near you at the moment.

Start an AUG

You're one step closer to meeting fellow Atlassian users at your local meet up. Learn more about AUGs

Groups near you