Create
cancel
Showing results for 
Search instead for 
Did you mean: 
Sign up Log in

Setting --max-concurrent-uploads for self-hosted Linux docker runner?

compumike
I'm New Here
I'm New Here
Those new to the Atlassian Community have posted less than three times. Give them a warm welcome!
March 25, 2024

One of our pipeline steps is a `docker push` to a remote registry. The image has many layers.

This upload could be faster if we could increase the `--max-concurrent-uploads` that `dockerd` is started with (default 5).

Is it possible to change the `--max-concurrent-uploads` and `--max-concurrent-downloads` flags of the dind dockerd, or increase their default values? Thanks.

1 answer

0 votes
Syahrul
Atlassian Team
Atlassian Team members are employees working across the company in a wide variety of roles.
March 26, 2024

G'day, @compumike 

Welcome to the community!

Have you tried increasing it in the docker daemon config? I believe you can increase that in daemon.json for example:

{
"max-concurrent-downloads": 5,
"max-concurrent-uploads": 5,
"max-download-attempts": 5
}

Regards,
Syahrul

compumike
I'm New Here
I'm New Here
Those new to the Atlassian Community have posted less than three times. Give them a warm welcome!
March 26, 2024

Yes, I have that on the host system's `/etc/docker/daemon.json` with `max-concurrent-downloads/uploads` set to `50`.

However, the Bitbucket Linux Docker self-hosted runner spawns a new `dockerd` instance within the runner. How can I set the config for that docker-in-docker `dockerd`? Thanks.

Syahrul
Atlassian Team
Atlassian Team members are employees working across the company in a wide variety of roles.
March 27, 2024

Hey @compumike 

You are correct; my bad about that.  Can you share your YAML example so I can review it and see if there's any alternate workaround available?

Regards,
Syahrul

Suggest an answer

Log in or Sign up to answer
DEPLOYMENT TYPE
CLOUD
PERMISSIONS LEVEL
Site Admin
TAGS
AUG Leaders

Atlassian Community Events