I have the following bitbucket pipeline, which is for deploying a Meteor app with Mup. Everything is working up until the final mup deploy command it seems to not to be able to read the generated config.json file that is supposed to have my secure mongo url injected into it. this is what the secure_mongo.json file looks like { "secret" : $STAGING_MONGO_URL } In the mup file I access like var mongo = require ( './config.json' ); module . exports = { MONGO_URL : mongo. secret , } image : node : 14.16 .0 pipelines : branches : staging : - step : name : Deploy to staging CI / CD Environment script : - mkdir -p ~/. ssh - apt-get update && apt-get install gettext-base - curl https : //install.meteor.com/ | sh - export METEOR_ALLOW_SUPERUSER = true - cd . bot -staging-ci-cd - (umask 077 ; echo $DO_STAGING_CICD_SSH_KEY | base64 --decode > ~ /.ssh/i d_rsa) - cat secure_mongo. json | envsubst > config. json - cat config. json && realpath config. json - npm install -g mup - npm install -g ssh2 - mup deploy And I do have a secure variable named $STAGING_MONGO_URL in the repository. So Not entirely sure what is going wrong. Any help would be great. This question is related and helped me get this far Storing secrets into Bitbucket Pipelines and then deploy on App Engine? but it is not the same question. To be clear the error I am getting is Mup deploy is saying that the config.json file is reaching an Unexpected token exact error Error loading config file : SyntaxError : /opt/ atlassian/pipelines/agent/build/. bot -staging-ci-cd/config. json : Unexpected token m in JSON at position 13 Also the cat command for the new config.json never reveals the secret just shows the variable $STAGING_MONGO_URL in place, I wonder if the envsubst is working at all? Thanks

nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Using envsubst for a Meteor app with bitbucket pipelines

Anders Kitson_uxubth

I have the following bitbucket pipeline, which is for deploying a Meteor app with Mup.

Everything is working up until the final mup deploy command it seems to not to be able to read the generated config.json file that is supposed to have my secure mongo url injected into it.

this is what the secure_mongo.json file looks like

{
    <span>"secret"</span>: $STAGING_MONGO_URL
}

In the mup file I access like

<span>var</span> mongo = <span>require</span>(<span>'./config.json'</span>);

<span>module</span>.<span>exports</span> = {
  <span>MONGO_URL</span>: mongo.<span>secret</span>,
}

<span>image</span>: <span>node</span>:<span>14.16</span><span>.0</span>

<span>pipelines</span>:
  <span>branches</span>:
    <span>staging</span>:
      -  <span>step</span>:
           <span>name</span>: <span>Deploy</span> to staging <span>CI</span>/<span>CD</span> <span>Environment</span>
           <span>script</span>:
             - mkdir -p ~/.<span>ssh</span>
             - apt-get update && apt-get install gettext-base
             - curl <span>https</span>:<span>//install.meteor.com/ | sh</span>
             - <span>export</span> <span>METEOR_ALLOW_SUPERUSER</span>=<span>true</span>
             - cd .<span>bot</span>-staging-ci-cd
             - (umask <span>077</span> ; echo $DO_STAGING_CICD_SSH_KEY | base64 --decode > ~<span>/.ssh/i</span>d_rsa)
             - cat secure_mongo.<span>json</span> | envsubst > config.<span>json</span>
             - cat config.<span>json</span> && realpath config.<span>json</span>
             - npm install -g mup
             - npm install -g ssh2
             - mup deploy

And I do have a secure variable named $STAGING_MONGO_URL in the repository. So Not entirely sure what is going wrong. Any help would be great.

This question is related and helped me get this far Storing secrets into Bitbucket Pipelines and then deploy on App Engine? but it is not the same question.

To be clear the error I am getting is Mup deploy is saying that the config.json file is reaching an Unexpected token

exact error

<span>Error</span> loading config <span>file</span>:
<span>SyntaxError</span>: <span>/opt/</span>atlassian/pipelines/agent/build/.<span>bot</span>-staging-ci-cd/config.<span>json</span>: <span>Unexpected</span> token m <span>in</span> <span>JSON</span> at position <span>13</span>

Also the cat command for the new config.json never reveals the secret just shows the variable $STAGING_MONGO_URL in place, I wonder if the envsubst is working at all?

Thanks

Accepted answers

Anders Kitson_uxubth

For anyone running into the same problem, this is what I ended having as my pipeline. Also the mongo url needed to be in quotes when I added it to the environment variables.

image: node:14

pipelines:

branches:

staging:

 - step:

name: Deploy to staging CI/CD Environment

script:

 - mkdir -p ~/.ssh

 - apt-get update && apt-get install gettext-base

 - curl https://install.meteor.com/ | sh

 - export METEOR_ALLOW_SUPERUSER=true

 - cd .bot-staging-ci-cd

 - (umask 077 ; echo $DO_STAGING_CICD_SSH_KEY | base64 --decode > ~/.ssh/id_rsa)

 - cat mup-secure.js | envsubst > mup.js

 - cat settings-secure.json | envsubst > settings.json

 - rm -rf node_modules

 - npm install -g mup

 - npm install -g ssh2

 - meteor npm i

 - mup setup

 - mup deploy --settings settings.json

All comments

Igor Stoyanov

@Anders Kitson hi. Thanks for your question.

Try to use envsubst this way:

- envsubst < secure_mongo.json > config.json

maybe this will help.

Regards, Igor

Theodora Boudale

Hi Anders,

I am not familiar with Meteor, but I just wanted to add that if the value of a secured variable exists in the Pipelines build log, it is always replaced with the variable name. Seeing $STAGING_MONGO_URL in the Pipelines build log is expected since you are using a secured variable.

If you want to check the content of the config.json file after a build runs, you can define it as an artifact in this step (see this doc also on artifacts):

artifacts: 
  - .bot-staging-ci-cd/config.json

You will then be able to download it from the Artifacts tab in the Pipelines build log and check its content.

Please keep in mind that artifacts are stored for 14 days following the execution of the step that produced them and they can be downloaded by anyone with access to the repo.

Kind regards,
Theodora

Anders Kitson_uxubth

For anyone running into the same problem, this is what I ended having as my pipeline. Also the mongo url needed to be in quotes when I added it to the environment variables.

image: node:14

pipelines:

branches:

staging:

 - step:

name: Deploy to staging CI/CD Environment

script:

 - mkdir -p ~/.ssh

 - apt-get update && apt-get install gettext-base

 - curl https://install.meteor.com/ | sh

 - export METEOR_ALLOW_SUPERUSER=true

 - cd .bot-staging-ci-cd

 - (umask 077 ; echo $DO_STAGING_CICD_SSH_KEY | base64 --decode > ~/.ssh/id_rsa)

 - cat mup-secure.js | envsubst > mup.js

 - cat settings-secure.json | envsubst > settings.json

 - rm -rf node_modules

 - npm install -g mup

 - npm install -g ssh2

 - meteor npm i

 - mup setup

 - mup deploy --settings settings.json

Anders Kitson_uxubth

copy and paste butchered my yaml sorry.

Anders Kitson_uxubth

Thanks that is super helpful to know. I did solve my problem

Welcome!

It looks like you're new here. Sign in or register to get started.

Quick Links

Find more posts tagged with

cloud

bitbucket

bitbucket-cloud

bitbucket-pipelines