Pipelines Rsync only latest commits and changed files

Is there an easy way to just rsync files that were changed since the last commit?
Because now there is Pipelines Deployments and I do not like the fact that I am rsyncing my whole website while I only need a few files that were changed.

Does anyone know a way to do this?

1 answer

0 votes
Jim Redmond Atlassian Team Feb 11, 2018

Rsync is already incremental - it will only push (or pull) the difference between source and destination.

Yes, true, but since the environment that I am syncing to, has been updated last week (for example). And my Docker image has just been created. The files on the Docker images, are ALWAYS newer than the files on the environment that I want to sync to.

So I can not choose to just sync changed files, since every single file in my docker images, always has a newer date than the files on the server, since those were already there before I started the Docker images.

So how am I going to fix that?

If it is just the date that is an issue, you can add the -c flag to synchronize based on checksum.


 -c, --checksum              skip based on checksum, not mod-time & size

This still is not enough, I got this command right now:

rsync -hvrPtu --checksum --delete --filter="merge filter.txt" ../build/ $ACC_USER@$ACC_HOST:$ACC_PATH

with this in the filter.txt

P public_html/sites/default/files/***
P config/***
P config/**
P config/*
P config/
P config
P private_html/***
P private_html/**
P private_html/*
P private_html/
P private_html
+ public_html/***
+ config/***
- ***
- **.gitkeep

 But it deletes the whole domain directory, so including the private_html symlink and a whole lot more.

Also, when deploying a newer version of Drupal, it doesn't sync anything. Just some folders, and that while the whole core was changed.
Any other ideas?

@Arjan Oskam how did you resolve this

@Marc Robinson I never have been able to resolve this

Suggest an answer

Log in or Sign up to answer
Community showcase
Published Nov 06, 2018 in Bitbucket

Upgrade Best Practices

Hello! My name is Mark Askew and I am a Premier Support Engineer for products Bitbucket Server/Data Center, Fisheye & Crucible. Today, I want to bring the discussion that Jennifer, Matt, and ...

655 views 5 9
Read article

Atlassian User Groups

Connect with like-minded Atlassian users at free events near you!

Find a group

Connect with like-minded Atlassian users at free events near you!

Find my local user group

Unfortunately there are no AUG chapters near you at the moment.

Start an AUG

You're one step closer to meeting fellow Atlassian users at your local meet up. Learn more about AUGs

Groups near you