An overview on the jobs which are running on dbt. we have dbt models run from dbt cloud and the models are pulled from bitbucket repository and executed, but recently we are noticing issues while dbt jobs invocation and the message as follows.
"Failed to clone repository.
git clone <repo_url> /tmp/jobs/29399885/target
Cloning into '/tmp/jobs/29399885/target'...
Warning: Permanently added 'bitbucket.org,126.96.36.199' (RSA) to the list of known hosts.
error: index-pack died of signal 9
fatal: index-pack failed"
So on multiple retry the job gets executed. without any issue with the clone. would like to know if this is something related to storage issue or memory issue. on checking the repository properties on bitbucket.org, i was unable to see any properties related to memory. only property i could see is the repo storage.
Kindly suggest how to resolve this issue.
Hi @Mischal and welcome to the community.
I've seen issues with the same error reported before, and the culprit in most cases was the memory on the client machine performing the clone. Some users have resolved it by adding more memory to their machine. If a repo has large files, this can also contribute to the issue, for other users the issue was resolved by removing large files from Git history:
If your repo has large files and you decide to remove them from Git history, we'll need to run a git gc on the remote after you push your changes. You can either leave a comment here to request that or open a ticket with the support team via https://support.atlassian.com/contact/#/.
Just a heads up, I removed the URL of your repo from your post to protect your privacy.
Beginning on April 4th, we will be implementing push limits. This means that your push cannot be completed if it is over 3.5 GB. If you do attempt to complete a push that is over 3.5 GB, it will fail...
Connect with like-minded Atlassian users at free events near you!Find an event
Connect with like-minded Atlassian users at free events near you!
Unfortunately there are no Community Events near you at the moment.Host an event
You're one step closer to meeting fellow Atlassian users at your local event. Learn more about Community Events