It's not the same without you

Join the community to find out what other Atlassian users are discussing, debating and creating.

Atlassian Community Hero Image Collage

How is the SCP job type of any use whatsoever?

Looking at the documentation for Bamboo, I see that the SCP job type is available for copying files from the agent to somewhere else.

But it seems, based on my understanding of Bamboo, that this is completely useless, because I have no way to ensure that the files I want to copy will exist.

  • If the files are created by another job in the same stage, I have no guarantees about what order the jobs run/complete in, so I can't be certain the files will be created before I try to scp them.
  • If the files are created by a job in a different stage, I have no guarantees about whether the stages will be run on the same build server, so, once again, I can't be certain that the files I want will be present.

What am I missing?

1 answer

1 accepted

0 votes
Answer accepted

Hi @John Maxwell

thank you for explaining your pain point with a clear and structured message =]

We shouldn't try to use any result from another job in the same stage. As you correctly mentioned we have no guarantees that they will finish on a certain order. Jobs are intended to run in parallel to reduce build time when doing tasks that have no dependency among each other. That is why we also have stages.

Stages will run in sequence and should be used in case we need two different jobs running one after another. 

The best way to share data from one job to another is by using artifacts. Stage X publishes the artifact. Stage Y, which runs after X (right after or multiple stages later), will download the artifact. This will assure that a job can run on any server and still have the specific files needed from a previous job to deploy.

I hope I could clarify the scenario for you. If not, please let me know what questions you still have.

I'll share a link to a video which I believe is extremely useful (although it is already old) to understand the Bamboo building blocks.
This is the one: 

In summary, I do recommend you to use stages and artifacts to make sure you have the files you need to deploy via SCP task.

Ahhh... I was thinking of artifacts as outputs from the plan as a whole. I hadn't considered them for sharing across jobs/stages. That was the missing piece; thanks.

Like Daniel Santos likes this

You are welcome @John Maxwell

Suggest an answer

Log in or Sign up to answer
Community showcase
Published in Bamboo

Unable to add or edit Bitbucket Cloud repository in Bamboo

On 31 May, a GDPR-related change went live in the Bitbucket Cloud API that resulted in users not being able to create or edit Bitbucket Cloud Linked repositories in Bamboo. This API update removed t...

659 views 2 7
Read article

Community Events

Connect with like-minded Atlassian users at free events near you!

Find an event

Connect with like-minded Atlassian users at free events near you!

Unfortunately there are no Community Events near you at the moment.

Host an event

You're one step closer to meeting fellow Atlassian users at your local event. Learn more about Community Events

Events near you