The Atlassian Community Forums are currently in read-only mode. We will be relaunching on a new platform on September 22 (read more here). We apologize for the extended downtime. For concerns or questions, please email communitymanagers@atlassian.com. See you on the other side, on the new Atlassian Community Forums! :)

×

Forums

Articles
Create
cancel
Showing results for 
Search instead for 
Did you mean: 

Setting --max-concurrent-uploads for self-hosted Linux docker runner?

compumike
March 25, 2024

One of our pipeline steps is a `docker push` to a remote registry. The image has many layers.

This upload could be faster if we could increase the `--max-concurrent-uploads` that `dockerd` is started with (default 5).

Is it possible to change the `--max-concurrent-uploads` and `--max-concurrent-downloads` flags of the dind dockerd, or increase their default values? Thanks.

1 answer

Comments for this post are closed

Community moderators have prevented the ability to post new answers.

0 votes
Syahrul
Atlassian Team
Atlassian Team members are employees working across the company in a wide variety of roles.
March 26, 2024

G'day, @compumike 

Welcome to the community!

Have you tried increasing it in the docker daemon config? I believe you can increase that in daemon.json for example:

{
"max-concurrent-downloads": 5,
"max-concurrent-uploads": 5,
"max-download-attempts": 5
}

Regards,
Syahrul

compumike
March 26, 2024

Yes, I have that on the host system's `/etc/docker/daemon.json` with `max-concurrent-downloads/uploads` set to `50`.

However, the Bitbucket Linux Docker self-hosted runner spawns a new `dockerd` instance within the runner. How can I set the config for that docker-in-docker `dockerd`? Thanks.

Syahrul
Atlassian Team
Atlassian Team members are employees working across the company in a wide variety of roles.
March 27, 2024

Hey @compumike 

You are correct; my bad about that.  Can you share your YAML example so I can review it and see if there's any alternate workaround available?

Regards,
Syahrul

DEPLOYMENT TYPE
CLOUD
PERMISSIONS LEVEL
Product Admin
TAGS
AUG Leaders

Atlassian Community Events