Pipelines: How to cache dependencies with custom pipes

[pablodenadai]

Given the pipeline configuration below:

image: node:12.3.1

pipelines:
  default:
    - step:
      caches:
        - npm
        - bower
      script:
        - pipe: docker://username/pipe:0.0.1
      artifacts:
        - dist/**

definitions:
  caches:
    npm: $HOME/.npm
    bower: $HOME/.cache/bower/

1. How do I cache the custom pipe "docker://username/pipe:0.0.1"?
2. Why isn't .npm and bower being cached properly?
   

   Cache "npm": Downloading
   Cache "npm": Not found
   Cache "bower": Downloading
   Cache "bower": Not found

PS. I'm not looking at caching the node_modules folder. Instead I need to cache npm's cache.

[Alexander Zhukov]

Hi @pablodenadai . Pipelines don't cache files created inside a pipe. Is this something that you want to achieve?

[ezhou]

@Alexander Zhukov I am facing a similar problem. This is a deal breaker when building with dependencies on large repositories. For reference, I'm experimenting with the JFrog Artifactory custom pipe and builds for simple example maven projects are taking 5 minutes.

[cec_lugano]

@Alexander Zhukov is this still the case now?

This is a massive problem for our organization.

It defeats the advantage of having pipes maintained by Atlassian or vendors.

And even custom pipes for code sharing in an organization may be impaired by this.

Thank you