Create
cancel
Showing results for 
Search instead for 
Did you mean: 
Sign up Log in
Celebration

Earn badges and make progress

You're on your way to the next level! Join the Kudos program to earn points and save your progress.

Deleted user Avatar
Deleted user

Level 1: Seed

25 / 150 points

Next: Root

Avatar

1 badge earned

Collect

Participate in fun challenges

Challenges come and go, but your rewards stay with you. Do more to earn more!

Challenges
Coins

Gift kudos to your peers

What goes around comes around! Share the love by gifting kudos to your peers.

Recognition
Ribbon

Rise up in the ranks

Keep earning points to reach the top of the leaderboard. It resets every quarter so you always have a chance!

Leaderboard

Come for the products,
stay for the community

The Atlassian Community can help you and your team get more value out of Atlassian products and practices.

Atlassian Community about banner
4,465,889
Community Members
 
Community Events
176
Community Groups

How can I use `rest/api/content` to download all the 800k pages of my Confluence wiki without timing

I  want to download all the 800k pages of my Confluence wiki.

I'd like to use:

curl -u wikiusername:wikipassword https://wiki.hostname.com/rest/api/content?start=1`

and simply increase start from 1 to 800000.

However, the response time increases as start increases, and from ~80000 begins to timeout:

startresponse time (seconds)
10.4
1,0002.5
10,0009
50,000112
100,000timeout

How can I use rest/api/content to download all the 800k pages of my Confluence wiki without timing out?

1 answer

0 votes

This is because when you make the REST call, the server is trying to build the response in memory before it can send it back.  If you make it too large, the process will fail.

You're going to need to page through what you're trying to download, you can't do it in one massive great chunk (unless you increased the server memory to something massive)

I'd also want to quickly question why?  What is this download going to do for you?  I'm thinking there may be a better option (like parsing a backup)

Suggest an answer

Log in or Sign up to answer
TAGS

Atlassian Community Events