Need solution for mass content migration from Google Drive to Confluence Server

[TinTin]

Hello, Smart People!

Here's my problem, with detailed requirements. Right now, we're doing this manually, and it will take our team many, many months.

I need to migrate tens of thousands of files of varying types from Google Drive into Confluence Server pages.

Our solution must be able to do the following:

• For Google Docs or MS Word files, we need to 

  • Convert the original doc file into a Confluence page, retaining most if not all of the formatting, and all the images.

  • Right now, we're opening each file, and manually copying and pasting and reformatting.

• For non-doc types (Sheets, Slides, media) we need to

  • Embed the file into a Confluence page.

  • Right now, we're either
    • using a macro in Confluence to embed the original Drive file, or
    • manually embedding non-Google files into a page.

We also need to:

• Output a log/list/inventory to Google Sheets with specific details of what  was transferred, the source location, destination, etc.

• Meet corporate security requirements, including access limitations and data retention.

• Be tested thoroughly before implementation.

Nice to have options:

• Can determine source file location on Drive side.

• Can recreate source file folder location on the Confluence side. e.g., If the source file was in /documents/taxes/ then it will create a documents page in confluence, a taxes page inside that, and put the file into that target.

• Can read Confluence labels.

• Content reformat or cleanup option. e.g., strip tags, remove markup, things like that.

• Integration with existing Confluence macros.

Is there a way to leverage automation or another tool to do this sort of thing? Even if it requires more advanced solutions, like API use and webhooks?

We have considered some automated solutions with no luck so far.

• Zapier, IFTT is not robust enough.
• Confluence Automation isn't supported on Server.

Thank you for looking!

[Aron Gombas _Midori_ · Accepted solution]

Seeing your requirements, I don't think that there will be an OOTB solution that precisely meets those.

But, all these components in your process (Google Drive and Confluence) have well-dedicated APIs. Which means you can develop a migrator script in your favourite programming language. You can test that by migrating the things to Confluence Server staging instance(s) that you can drop.

If you want the extra processing steps with clean-ups, conversions, etc. it also means that you need to build it for yourself, because ready-made solutions (if there are) won't do what you require.