Setting --max-concurrent-uploads for self-hosted Linux docker runner?

Question

One of our pipeline steps is a `docker push` to a remote registry. The image has many layers.

This upload could be faster if we could increase the `--max-concurrent-uploads` that `dockerd` is started with (default 5).

Is it possible to change the `--max-concurrent-uploads` and `--max-concurrent-downloads` flags of the dind dockerd, or increase their default values? Thanks.

Syahrul · Answer

Hey @compumike

You are correct; my bad about that.  Can you share your YAML example so I can review it and see if there's any alternate workaround available?

Regards,
Syahrul

compumike · Answer

Yes, I have that on the host system's `/etc/docker/daemon.json` with `max-concurrent-downloads/uploads` set to `50`.

However, the Bitbucket Linux Docker self-hosted runner spawns a new `dockerd` instance within the runner. How can I set the config for that docker-in-docker `dockerd`? Thanks.

Syahrul · Answer

G'day, @compumike

Welcome to the community!

Have you tried increasing it in the docker daemon config? I believe you can increase that in daemon.json for example:

{
"max-concurrent-downloads": 5,
"max-concurrent-uploads": 5,
"max-download-attempts": 5
}

Regards,
Syahrul