Pipeline cache doesn't work as expected

Uliana Andreeva

Hi there,

I have a problem with the maven cache. 

On the first step I see that cache is extracted successfully:

Cache "mvnrepo": Downloading
Cache "mvnrepo": Downloaded 55 MB in 4 seconds
Cache "mvnrepo": Extracting
Cache "mvnrepo": Extracted in 0 seconds

No new dependencies downloaded during this step and in "Build teardown" section I see:

Cache "mvnrepo": Skipping upload for existing cache

On the second step I see again that cache is extracted successfully, but then new dependencies are downloaded during this step. But in "Build teardown" section I see again that cache uploading is skipped. And of course, when I rerun this build, this dependencies are again downloaded on the second step.

What should I change for update cache after second step to save cache between builds and avoid downloading dependencies again and again? 

My bitbucket-pipelines.yml file: 

image: maven:3.3.9

pipelines:
  default:
    - step:
        name: Unit testing
caches:
          - mvnrepo
script:
          - mvn -B test
    - step:
        name: Package build
caches:
          - mvnrepo
script:
          - mvn -B package -DskipTests
definitions:
  caches:
    mvnrepo: /root/.m2/repository

I tried using default 'maven' cache name in caches section, but the result is the same.

Steven Vaccarella

Hi Uliana,

The cache is only uploaded if it doesn't already exist. This is by design, to avoid incurring the expense of uploading the cache on every run. The cache will be automatically cleared when it is a week old or it can be cleared manually in the UI. If your two steps have substantially different dependencies you could create two separate caches, one for each step. Eg:

image: maven:3.3.9

pipelines:
  default:
    - step:
        name: Unit testing
caches:
          - mvnrepo1
script:
          - mvn -B test
    - step:
        name: Package build
caches:
          - mvnrepo2
script:
          - mvn -B package -DskipTests
definitions:
  caches:
    mvnrepo1: /root/.m2/repository
    mvnrepo2: /root/.m2/repository

See "How does caching work?" in the docs for more details: https://confluence.atlassian.com/bitbucket/caching-dependencies-895552876.html

Cheers,
Steven