Pipelines System Error when LFS clone enabled: true

jhonsen.djajamuliadi

I'm adding a step-level git-lfs clone in bitbucket-pipelines.yml file, as described here, but it throws a System Error during build. The repo I'm working on is a forked repo that had git-lfs configured (it had .gitattributes in the repo).

image: continuumio/anaconda3:latest

pipelines:

  pull-requests:

    '**': # runs as default for any branch
    - step:
        name: build test 
        clone:
          lfs: true
        script:
          - if [ -f environment.yml ]; then conda env create -f environment.yml; fi
          - git clone --branch="test" git@bitbucket<somerepo>

Error encountered: 

- error downloading object (error logs below)

 

Steps taken to resolve (but failed): 

- Removed step-level clone, and specified it globally, but same error encountered

- Added `git lfs install` as part of build step instead of using `clone: enabled: true` but git lfs command is not recognized

 

<span>+ umask 000</span>

<span>+ git lfs 2>/dev/null >/dev/null || if [ $? -ne 0 ]; then exit 86; fi</span>

<span>+ retry 6 git clone --branch="add_ci_backbone" &nbsp; $BUILD_DIR</span>

<span>Cloning into '/opt/atlassian/pipelines/agent/build'...</span>

<span>Downloading data/df_clean.csv&nbsp;(15 MB)</span>

<span><strong>Error</strong> downloading object: data/df_clean.csv&nbsp;(19f9dde): Smudge error: <strong>Error</strong> downloading data/df_clean.csv (sha...): [sha...] Object does not exist on the server: [404] <strong>Object does not exist on the server</strong></span>

<span><strong>Errors</strong> logged to '/opt/atlassian/pipelines/agent/build/.git/lfs/logs/20221003T160918.187587842.log'.</span>

<span>Use `git lfs logs last` to view the log.</span>

<span><strong>error</strong>: external filter 'git-lfs filter-process' failed</span>

<span>fatal: data/df_clean.csv: smudge filter lfs failed</span>

<span>warning: Clone succeeded, but checkout failed.</span>

<span>You can inspect what was checked out with 'git status'</span>

<span>and retry with 'git restore --source=HEAD :/'</span>

<span>Attempt 1 of 6 failed.</span>

<span>Retrying in 1 seconds</span>

<span>Attempt 2 of 6 failed.</span>

<span>Retrying in 2 seconds</span>

<span>fatal: destination path '/opt/atlassian/pipelines/agent/build' already exists and is not an empty directory.</span>

<span>fatal: destination path '/opt/atlassian/pipelines/agent/build' already exists and is not an empty directory.</span>

Syahrul

Hi @jhonsen.djajamuliadi 

Welcome to the community!

Based on the log you shared, the clone is failing because it fails to download LFS files:

Error downloading object: data/df_clean.csv (19f9dde): 
Smudge error: Error downloading data/df_clean.csv (sha...): [sha...] Object does not exist on the server: [404] Object does not exist on the server

The remote repository is missing "data/df_clean.csv" files as per the above error.

Can you check if you have these files locally by running the following commands:

Locate the missing files, UUID exists locally:

git lfs ls-files | grep 19f9dde

If the OID exists, push the files back to the remote repository:

git lfs push origin --all

Once pushed, re-run the pipeline build again and let me know if that works.

Cheers,
Syahrul