Best practice for pipeline server deployment

We are evaluating pipelines for our continuous deployments and I'm hitting something of a roadblock. Our current deployment strategy uses rsync to upload changes to our dev and staging servers. Unfortunately, rsync isn't a great solution with Bitbucket pipelines because the docker container does a fresh git pull of the repo branch. This means rsync will always copy all the files rather than just the changes from the last commit. I realize it will be slightly more efficient since it should still just copy diffs of the data, but it will still always consider all the files rather than commit changes.

Any ideas here about a deployment script? Our platform is CakePHP so it's all PHP files and web assets.

3 answers

1 accepted

This widget could not be displayed.

Hey @David Ethell,

There is a flag you can pass to rsync to make it ignore the timestamps of the files and rely only on the checksum. The flag is --ignore-times which should make your rsync command look something like this:

rsync --ignore-times <folder1> <folder2>

This should prevent unnecessary copies.

However, whether this is a good idea depends on what you're trying to accomplish. Calculating the checksums can be an expensive operation which may lead to longer build times.

Cheers,

Tom

For some reason I was worried that checksum calculation would slow things down, but this has greatly improved the run times and now correctly only uploads changed files. Thanks!

This widget could not be displayed.

I tried using this git-settimes gist to set the checked out timestamps in a way that should allow rsync to only upload changes but so far it does not appear to help.

This widget could not be displayed.

I'm not sure how git-settimes gist works. But it may be running into issues due to timezone differences. Your local commits may be on a different timezone to Pipelines. Pipelines runs on UTC. Your idea here makes sense, but maybe timezones are making things problematic for you here? smile

Suggest an answer

Log in or Sign up to answer
Community showcase
Published Aug 21, 2018 in Bitbucket

Branch Management with Bitbucket

As a project manager, I have discovered that different developers want to bring their previous branching method with them when they join the team. Some developers are used to performing individual wo...

1,199 views 8 10
Read article

Atlassian User Groups

Connect with like-minded Atlassian users at free events near you!

Find a group

Connect with like-minded Atlassian users at free events near you!

Find my local user group

Unfortunately there are no AUG chapters near you at the moment.

Start an AUG

You're one step closer to meeting fellow Atlassian users at your local meet up. Learn more about AUGs

Groups near you