Does Pipelines run the builds on AWS?

I am curious if Bitbucket Pipelines runs the actual tests on AWS or not (and if so, in which region?).  

If it is within AWS, I would suspect that if we used Amazon ECR as our Docker Registry that docker image downloads to Pipelines would be free (and likely faster than other options), as it would be within the AWS platform.

(I recognize that if the answer is yes now, Atlassian would likely not guarantee it forever, but would be nice to know for now anyways).

1 answer

1 vote

This is partially addressed in an InfoQ interview embedded in Bitbucket Pipelines Provides Continuous Delivery within Atlassian’s Bitbucket Cloud:

Pittet confirmed that Bitbucket Pipelines is implemented atop the Amazon EC2 Container Service (ECS). While this transparent and managed container usage is one of Pipeline’s value propositions, users have also requested the ability to execute builds in their own ECS cluster.

I'm not aware of an official statement regarding the facilitated ECS region, but given Jim's answer to Where are Bitbucket's data centers located? being "Virginia and California", I would assume Pipelines is running in a close by AWS region (i.e. one or more of the US regions). 

The ability to pull images from Amazon ECR is a fairly popular feature request already, which you might want to watch and vote for accordingly:

However, given the way images are currently referenced in the configuration file, I agree with the reporter's skepticism concerning the workaround proposed by a Bitbucket team member:

I'm pretty sure the eval statement needs to be run by the Bitbucket Pipelines process before it can download the correct Docker image within which to run user supplied code. Is there a way to customize the code run at that stage of the process?

The variable approach might be conceptually valid still, albeit composed differently, as I have outlined in my answer to Pipelines: Pulling docker images from a Amazon ECR repository - given the surprising lack of an API for updating Bitbucket Pipelines variables (which implies you'd need to update the variables with the ECR authentication credentials manually every 12 hours right now), I have never tried that though ...

Suggest an answer

Log in or Sign up to answer
Atlassian Community Anniversary

Happy Anniversary, Atlassian Community!

This community is celebrating its one-year anniversary and Atlassian co-founder Mike Cannon-Brookes has all the feels.

Read more
Community showcase
Piotr Plewa
Published Dec 27, 2017 in Bitbucket

Recipe: Deploying AWS Lambda functions with Bitbucket Pipelines

Bitbucket Pipelines helps me manage and automate a number of serverless deployments to AWS Lambda and this is how I do it. I'm building Node.js Lambda functions using node-lambda&nbsp...

2,029 views 1 5
Read article

Atlassian User Groups

Connect with like-minded Atlassian users at free events near you!

Find a group

Connect with like-minded Atlassian users at free events near you!

Find my local user group

Unfortunately there are no AUG chapters near you at the moment.

Start an AUG

You're one step closer to meeting fellow Atlassian users at your local meet up. Learn more about AUGs

Groups near you