Pipelines: How to cache dependencies with custom pipes

Question

Given the pipeline configuration below: image: node:12.3.1 pipelines: default: - step: caches: - npm - bower script: - pipe: docker://username/pipe:0.0.1 artifacts: - dist/** definitions: caches: npm: $HOME/.npm bower: $HOME/.cache/bower/ * How do I cache the custom pipe "docker://username/pipe:0.0.1"? * Why isn't .npm and bower being cached properly? Cache "npm": Not found Cache "bower": Downloading
Cache "bower": Not foundCache "npm": Downloading PS. I'm not looking at caching the node_modules folder. Instead I need to cache npm's cache.

cec_lugano · Answer

@Alexander Zhukov is this still the case now?

This is a massive problem for our organization.

It defeats the advantage of having pipes maintained by Atlassian or vendors.

And even custom pipes for code sharing in an organization may be impaired by this.

Thank you

ezhou · Answer

@Alexander Zhukov I am facing a similar problem. This is a deal breaker when building with dependencies on large repositories. For reference, I'm experimenting with the JFrog Artifactory custom pipe and builds for simple example maven projects are taking 5 minutes.

Alexander Zhukov_1bqyxb · Answer

Hi @pablodenadai . Pipelines don't cache files created inside a pipe. Is this something that you want to achieve?