I am making bitbucket api more than 1000 times , I am getting resource exhausted exception

Question

I am getting 429 Rate limit for this resource has been exceeded, can anyone help me to understand how I can increase this rate limit . Earlier I have created clients using ussername/password and now I tried with workspace access token but this issue still persists. I thought of downloading the whole directory in memory to avoid doing get calls but it seems there is no such api to download the content recursively from a dirrectory though we have same option from UI.

Ankit Gupta_hdvwuq · Answer

Thanks for the update @Ben , can we use workspace access token to download a directory as zip , or we need to use username:password only, as I tried the api to get as zip using workspace access token is not working but with username:password I was able to do so .

Ben · Answer

Hi @Ankit Gupta

While the rate limit is not able to be increased (see above comment listing the feature request), each workspace token has a 1,000 request limit so you can create multiple workspace tokens and split the requests across these. Say you needed to send 3,000 requests per hour for example, you could send 1,000 using WorkspaceTokenA, another 1,000 using WorkspaceTokenB and another 1,000 using WorkspaceTokenC.

As for recursive file downloading, this is more a limitation of cURL/wGet, we do have file downloading capabilities in our API so I will share this documentation as well as some external documentation that provides some assistance with working around cURL/wGet limitations:

* https://confluence.atlassian.com/bbkb/how-to-download-repositories-using-the-api-1188780893.html
* https://rakeshjain-devops.medium.com/download-files-and-directories-from-web-using-curl-and-wget-9217bc2e34c9

Hope this helps.

Cheers!

- Ben (Bitbucket Cloud Support)

Saxea _Flowie_ · Answer

Hi @Ankit Gupta

This has been reported here, and a possible workaround is to use repository/workspace tokens.