Long build queue time

I've been experiencing longer and longer build queue times recently. It happens on all plans, but one plan in particular is problemsome because it is a single-file merge queue that we use as a gatekeeper for merging pulls into master. We manually queue custom builds using the API and they routinely sit there with a message like so:

> Build:#301 has been queued for 11 minutes

This is supremely frustrating when there are a few pulls waiting to be tested and merged but they are mysteriously left sitting in a queue waiting for seemingly nothing.

I'm seeing things like this in the Bamboo agent's logs:

INFO   | jvm 9    | 2016/11/09 18:05:08 | 2016-11-09 18:05:08,512 INFO [0-BAM::smc-2-cpu-01d.corp.<redacted>.com::Agent:pool-3-thread-1] [BuildAgentControllerImpl] Agent 67666427 checking build queue for executables...
INFO   | jvm 9    | 2016/11/09 18:10:08 | 2016-11-09 18:10:08,645 INFO [0-BAM::smc-2-cpu-01d.corp.<redacted>.com::Agent:pool-3-thread-1] [BuildAgentControllerImpl] Agent 67666427 checking build queue for executables...
INFO   | jvm 9    | 2016/11/09 18:13:24 | 2016-11-09 18:13:24,346 INFO [remoteEventRebroadcasterMessageListenerContainer-1] [RemoteEventRebroadcasterMessageListener] ExecutableQueueUpdate: addToQueue, agents known to be affected: []
INFO   | jvm 9    | 2016/11/09 18:13:24 | 2016-11-09 18:13:24,347 INFO [0-BAM::smc-2-cpu-01d.corp.<redacted>.com::Agent:pool-3-thread-1] [BuildAgentControllerImpl] Agent 67666427 checking build queue for executables...
INFO   | jvm 9    | 2016/11/09 18:13:31 | 2016-11-09 18:13:31,083 INFO [remoteEventRebroadcasterMessageListenerContainer-1] [RemoteEventRebroadcasterMessageListener] ExecutableQueueUpdate: addToQueue, agents known to be affected: []
INFO   | jvm 9    | 2016/11/09 18:13:31 | 2016-11-09 18:13:31,084 INFO [0-BAM::smc-2-cpu-01d.corp.<redacted>.com::Agent:pool-3-thread-1] [BuildAgentControllerImpl] Agent 67666427 checking build queue for executables...
INFO   | jvm 9    | 2016/11/09 18:16:36 | 2016-11-09 18:16:36,919 INFO [remoteEventRebroadcasterMessageListenerContainer-1] [RemoteEventRebroadcasterMessageListener] ExecutableQueueUpdate: addToQueue, agents known to be affected: []
INFO   | jvm 9    | 2016/11/09 18:16:36 | 2016-11-09 18:16:36,919 INFO [0-BAM::smc-2-cpu-01d.corp.<redacted>.com::Agent:pool-3-thread-1] [BuildAgentControllerImpl] Agent 67666427 checking build queue for executables...
INFO   | jvm 9    | 2016/11/09 18:21:37 | 2016-11-09 18:21:37,130 INFO [0-BAM::smc-2-cpu-01d.corp.<redacted>.com::Agent:pool-3-thread-1] [BuildAgentControllerImpl] Agent 67666427 checking build queue for executables...

 

Yet it doesn't pick up the job for quite some time. The current build finally hit 15 minutes in the queue and then the agent decided to consume it and it finished in under a minute. This is beginning to be a serious hinderance in our ability to develop code.

Any explanation would be greatly appreciated.

4 answers

Anybody have an explanation? I'd love to fix this because the current behavior is a bit ridiculous.

I'm not sure but check whether the clocks are synchronized on the server and the agent.

I'm using Bamboo Cloud so I don't have access to the server clock. However, the clock on the dedicated agent matches what is shown on www.time.gov.

I switched to Bamboo Server and there haven't been any delays between queueing and running on the remote agent so far.

Suggest an answer

Log in or Sign up to answer
Community showcase
Posted Monday in Confluence

Organizing your space just got easier - Page Tree Drag & Drop is here

Hi Community! I’m Elaine, Confluence Product Manager. You may have read my earlier post about page tree in space navigation sidebar. I'm excited to share another improvement that helps you organize ...

103 views 3 4
Join discussion

Atlassian User Groups

Connect with like-minded Atlassian users at free events near you!

Find a group

Connect with like-minded Atlassian users at free events near you!

Find my local user group

Unfortunately there are no AUG chapters near you at the moment.

Start an AUG

You're one step closer to meeting fellow Atlassian users at your local meet up. Learn more about AUGs

Groups near you