How to store files on a bucket subdirectory using google-cloud-storage-deploy

André Rugere_xuquee

Hi guys!

I built a simple pipeline to copy files from a folder and upload them to a GCS bucket using the google-cloud-storage-deploy pipe, as shown below:

# Copy dags files to GCS bucket
pipelines:
default:
- step:
name: 'Pushing files to GCS bucket' 
script:
- pipe: atlassian/google-cloud-storage-deploy:2.0.0
variables:
KEY_FILE: $GOOGLE_SERVICE_ACCOUNT_KEY
BUCKET: 'bucket-test'
SOURCE: 'files/'

However, I don't want these files to be stored in the root of bucket-test, I want them in a subdirectory called folder.

Is it possible to do that using the google-cloud-storage-deploy pipe? I couldn't find an example and got errors when trying to do that by passing bucket-test/folder as a value for the BUCKET variable.

So in summary, right now this pipeline is doing this:

.
├── folder/
├── file1
├── file2
└── file3

and I want it to do this:

.
└── folder/
    ├── file1
    ├── file2
    └── file3

Thanks for your help!

Igor Stoyanov

Hi @André Rugere . We released new version 2.1.0 of the pipe, which allows you to upload to custom blob:

script:
  - pipe: atlassian/google-cloud-storage-deploy:2.1.0
    variables:
      KEY_FILE: $KEY_FILE
      BUCKET: 'my-bucket'
      SOURCE: 'myFile.txt'
      BLOB_NAME_PREFIX: 'my-folder/'

Regards, Igor