When using the S3 pipe https://bitbucket.org/atlassian/aws-s3-deploy/src we need to be able to set the `default.s3.max_concurrent_requests` value as we have lots of little files so the upload is slow.
The command to set it is `aws configure set default.s3.max_concurrent_requests 20` It would be great if this could be a configuration value. The default is 10.
@Halyna Berezovska Not sure if you are the right person to talk to about this. I would love to help and provide a PR if that is possible.
@Andrew McClenaghan I am the right person
Thanks for raising this. Soon we are going to work on s3 to improve it and can think about additional parameters. I will include your question to the discussion and notify you once we release a new update.
Regards, Galyna
@Andrew McClenaghan also , if you want to make a contribution, feel free to do it. We are happy to see new contributors. Just follow contributing guide in the pipe and don't forget to make a changeset in the pr, that will provide pipe's version bump on merge.
Also, take into account that we are going to refactor this pipe to Python in the next update, so if you do it now, you anyway will have to rewrite this to Python.
Generally, me , I like the idea if we pass additional aws config parameters and configure these params in the pipe.
I note that it would be different from any extra parameters types, because it provides params for aws config file, but not params to pass to functions variables.
But I would discuss this within the team.
If you want to do the contribution, tell us, so we can either wait for your contribution or implement this feature ourselves.
How far off do you think the change to python will be? We are having a very slow deploy at the moment so just comparing the time to fix this in the cli version vs waiting for the python version.
It looks like you're new here. Sign in or register to get started.
