Fetching the repo from Azure DevOps times out

[kobus maré]

We use Azure DevOps as build pipeline. I think we use Microsoft-hosted agents. 

Over the last 2 days we have been unable to successfully, fetch the repo from Bitbucket. It starts off downloading at a good enough speed (in excess of 15 MiB/s) and then starts dropping, it eventually comes down to 5 KiB/s) and then before it finishes, the pipeline times out after 60 minutes.

We did find some some unnecessary source fetches and tried to minimize, the amount of time we fetch the repo. In short, the pipeline is configured to execute 4 jobs, running on individual agents concurrently. How it was set up was that each job would spin up its agent, download the repo and then do its builds. We changed that now by adding a new job at the start to download the repo and store it an artifact. The agents then downloads the artifact instead of the repo. i.e. doing 1 download of the repo instead of 4.

However we are unable to even get this one download to complete. 

I am aware that Bitbucket added rate limiting recently, but we have not had this issue up until 2 days ago.

The size of the repo is:

•  Size: 832 MB
• Size on disk: 874 MB
• Contains: 21355 files, 3506 Folders

We are not aware of any network related issues

We use git commands to fetch the repo (i.e. not the API)

Any assistance and/or suggestions will be greatly appreciated

Thanks

[Theodora Boudale]

Hi Kobus and welcome to the community!

I see that you have created a support ticket as well for this issue. One of my colleagues asked for additional info in the support ticket for further investigation.

Kind regards,
Theodora