Showing results for 
Search instead for 
Did you mean: 
Sign up Log in

Does Bitbucket Pipeline has plans to support zstd for artifacts?

Olle Bröms
I'm New Here
I'm New Here
Those new to the Atlassian Community have posted less than three times. Give them a warm welcome!
March 8, 2024

The performance gains on both speed and compression is night an day compared to zip. I made a simple test to try to compress a medium size project using both zip and zstd. Here are the result:

The compression speed was ~10x faster. The compression result was ~5% smaller.

image (2).png


time gtar --zstd -cf monorepo.tar.zst monorepo
9.22s user 7.11s system 67% cpu 24.120 total


time zip --symlinks -q -r monorepo
106.35s user 8.87s system 87% cpu 2:11.07 total

The uncompression speed was ~8 faster.


time gtar --zstd -xf monorepo.tar.zst
3.52s user 15.62s system 117% cpu 16.348 total


time unzip -qq
24.81s user 18.56s system 97% cpu 44.481 total

Installation and versions

# Builtin tar in OSX doesn't support zstd.
# Just provided OSX installation but pretty sure it's supported on very platform.
> brew install zstd gnu-tar

> zip --version
Copyright (c) 1990-2008 Info-ZIP - Type 'zip "-L"' for software license.
This is Zip 3.0 (July 5th 2008), by Info-ZIP.

> gtar --version
tar (GNU tar) 1.35

> zstd --version
*** Zstandard CLI (64-bit) v1.5.5, by Yann Collet ***

Zstd is maintained by Facebook. So it's a serious project.

AWS started using it and also saw good results.

Right now "Build teardown" is the slowest part of my whole pipeline and takes approx 3min. Majority of the time is compressing different artifacts using zip in serial.

If this was done both in parallell and using zstd this would probably take 10s instead of 180s.

My idea would be to support something like this in bitbucket-pipelines.yml

- type: zstd
pattern: some/file-pattern1/**
- type: zip
pattern: some/file-pattern2/**
- some/file-pattern3/** # Default to zip


1 answer

1 accepted

1 vote
Answer accepted
Atlassian Team
Atlassian Team members are employees working across the company in a wide variety of roles.
March 10, 2024

G'day, @Olle Bröms 

Welcome to the community!


Thank you for providing a detailed test and a concise explanation. At this moment, I don't have specific information regarding any planned changes to the artifact compression.

However, I have initiated to raise a feature request on your behalf. This will allow you to comment, vote directly, and stay updated. If we decide to explore your suggestion in the future, you will receive an update.


Suggest an answer

Log in or Sign up to answer
AUG Leaders

Atlassian Community Events