Create
cancel
Showing results for 
Search instead for 
Did you mean: 
Sign up Log in

It's not the same without you

Join the community to find out what other Atlassian users are discussing, debating and creating.

Atlassian Community Hero Image Collage

Google Cloud Storage deploy rsync?

can anyone tell me how to use   rsync  with the google cloud storage deploy,  i've tried adding it in the EXTRA_ARGS: 'rysnc'   but it doesnt seem to like it.  I just want to upload changed files now the initial upload has been done and save a load of bandwidth charges.

 

thanks

1 answer

0 votes
Daniel Eads Atlassian Team Apr 28, 2020

Hi David,

Which pipe are you using? If you've started with the Google App Engine deploy example, I don't see rsync functionality (or flags) in the google cloud package the example relies on.

One option might be to use the rsync deploy pipeline instead, and deploy over SSH. Google provides some documentation here for getting set up with SSH access:

Cheers,
Daniel

im trying to use the 

Google Cloud Storage deploy pipe

Daniel Eads Atlassian Team Apr 28, 2020

Thanks for confirming. Looks like the underlying command for that pipeline is cp - on this particular line in the pipe we can see the cp command.

As it's currently written, this pipe can't utilize rsync. There are a couple options:

  1. Use the rsync deploy pipeline I linked above
  2. Fork this pipeline and modify it to use the gsutil rsync command instead of the "gsutil cp" command it's currently using

so basically just swap cp for rsync  on that line?  ( i'm not very good at this stuff)

 

wouldnt it be good for Atlassian to actually make this a pipe, as surely other must need similar as with the "google cloud storage deploy"  you can send all your stuff to a G bucket, but from then on, you have to send everything again, rather than just the "changed" files,  which cost a lot more each time in G costs

@davidstanton yes, you are right, if you want to use rsync exactly, right now you need to fork the pipe and replace there by rsync.

As for using this as a pipe, we should investigate this question. Thanks for the question!

lol, you just have to fork it and change the cp to rsync and you have a "new" pipe, thats useful to others and me hopefully? re-name it google rsync pipe 'syncs only changed files" ?

@davidstanton we are looking for the possibility to improve the current pipe, not creating the new one. Our own forking could end up in too many similar repos.

But as current solution you can fork it on your own and use it for now.

However, I will notify you once the solution for pipe improvement will be aproved and released

Like # people like this

Suggest an answer

Log in or Sign up to answer
TAGS
Community showcase
Published in Jira

Admins, notify your Jira instance of system-wide changes with the new admin announcement banner

Hi All! We’re excited to share the launch of an announcement banner that lets Jira site administrators communicate directly to their users across their  Jira Cloud instance.  ...

577 views 15 18
Read article

Community Events

Connect with like-minded Atlassian users at free events near you!

Find an event

Connect with like-minded Atlassian users at free events near you!

Unfortunately there are no Community Events near you at the moment.

Host an event

You're one step closer to meeting fellow Atlassian users at your local event. Learn more about Community Events

Events near you