I am not able to find a solution for delta upload to S3 bucket. Every time its uploading the entire folder.
Is there a provision for uploading only the changed + new files?
Adding EXTRA_ARGS: "--size-only" on the pipeline variable did the work for me..
As per document by AWS, `--size-only (boolean) Makes the size of each key the only criteria used to decide whether to sync from source to destination.`.
Hope this helps.
same issue here ... cant have partial sync whereas everything gets uploaded at any commit
"--size-only" seems to be working.
Thanks.
Hi @naspar try the way suggested by @ishwar rimal . It works.
yes i think it works, thanks everyone.
It looks like you're new here. Sign in or register to get started.