Best practice for pipeline server deployment

We are evaluating pipelines for our continuous deployments and I'm hitting something of a roadblock. Our current deployment strategy uses rsync to upload changes to our dev and staging servers. Unfortunately, rsync isn't a great solution with Bitbucket pipelines because the docker container does a fresh git pull of the repo branch. This means rsync will always copy all the files rather than just the changes from the last commit. I realize it will be slightly more efficient since it should still just copy diffs of the data, but it will still always consider all the files rather than commit changes.

Any ideas here about a deployment script? Our platform is CakePHP so it's all PHP files and web assets.

3 answers

1 accepted

1 vote

Hey @David Ethell,

There is a flag you can pass to rsync to make it ignore the timestamps of the files and rely only on the checksum. The flag is --ignore-times which should make your rsync command look something like this:

rsync --ignore-times <folder1> <folder2>

This should prevent unnecessary copies.

However, whether this is a good idea depends on what you're trying to accomplish. Calculating the checksums can be an expensive operation which may lead to longer build times.

Cheers,

Tom

For some reason I was worried that checksum calculation would slow things down, but this has greatly improved the run times and now correctly only uploads changed files. Thanks!

I tried using this git-settimes gist to set the checked out timestamps in a way that should allow rsync to only upload changes but so far it does not appear to help.

0 vote

I'm not sure how git-settimes gist works. But it may be running into issues due to timezone differences. Your local commits may be on a different timezone to Pipelines. Pipelines runs on UTC. Your idea here makes sense, but maybe timezones are making things problematic for you here? smile

Suggest an answer

Log in or Sign up to answer
Atlassian Community Anniversary

Happy Anniversary, Atlassian Community!

This community is celebrating its one-year anniversary and Atlassian co-founder Mike Cannon-Brookes has all the feels.

Read more
Community showcase
Piotr Plewa
Published Dec 27, 2017 in Bitbucket

Recipe: Deploying AWS Lambda functions with Bitbucket Pipelines

Bitbucket Pipelines helps me manage and automate a number of serverless deployments to AWS Lambda and this is how I do it. I'm building Node.js Lambda functions using node-lambda&nbsp...

2,030 views 1 5
Read article

Atlassian User Groups

Connect with like-minded Atlassian users at free events near you!

Find a group

Connect with like-minded Atlassian users at free events near you!

Find my local user group

Unfortunately there are no AUG chapters near you at the moment.

Start an AUG

You're one step closer to meeting fellow Atlassian users at your local meet up. Learn more about AUGs

Groups near you