Export Confluence space to a JSON using REST API

Question

We have data center version of confluence at on prem . I am trying to export all documents in a space. There are 127000 total docs in that space and each time my python scripts fails with below error and each time it successfully able to export 65000+ documents.

('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
Error fetching or decoding page batch after 5 attempts: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
Saved 70400 valid pages to confluence_pages.json

Bhuvnesh Vermani · Answer

I don't think it's a proxy or load balancer time out because I am able to export  close to 70,000 docs. The error I highlighted occurs post exporting 70,000 docs.

Matteo Vecchiato · Answer

Hi @Bhuvnesh Vermani ,

Welcome to Atlassian community and thank you for your question.

In my experience this kind of error is caused by a firewall, load balancer or proxy in front of the application. It usually is necessary to configure the timeout parameter in the specific software.

Moreover in Confluence there is also a timeout parameter: https://confluence.atlassian.com/doc/configuring-http-timeout-settings-184033.html

I hope it helps.

Kind regards