How do I need to configure an external search engine to scan a Confluence installation?

How do I need to configure an external search engine to scan a Confluence installation?

2 answers

Be sure that the pages you want to be indexed by an external search engine (like Google) are accessible by an anonymous user. You can use Google Webmaster Tools to add your Confluence instance to the Google search index.

If I misinterpreted your question, please elaborate on what you're trying to achieve.

When you say "external search engine", are you referring to a site like google.com, or are you talking about a search appliance that resides on another server within your organization?

Exactly, I was trying to configure SearchBlox to crawl jira.

Should just be able to point it to the server root. As long as you have no robots.txt file blocking access, it should be able to index the confluence site.

It is not so easy, I do not want the spider to index all the previous version of the documents. The default robots.txt does allow this and it pollutes the indexes.

can you configure the robots.txt to exclude paths to previous versions of teh doc? For example, our site uses space names to differentiate between versions, so we could exclude URLs that match the older versions' space names.

Suggest an answer

Log in or Sign up to answer
Atlassian Community Anniversary

Happy Anniversary, Atlassian Community!

This community is celebrating its one-year anniversary and Atlassian co-founder Mike Cannon-Brookes has all the feels.

Read more
Community showcase
Kesha Thillainayagam
Posted Apr 13, 2018 in Confluence

We want to hear how your non-technical teams are using Confluence!

Hi Community! Kesha (kay-sha) from the Confluence marketing team here! Can you share stories with us on how your non-technical (think Marketing, Sales, HR, legal, etc.) teams are using Confluen...

344 views 20 10
Join discussion

Atlassian User Groups

Connect with like-minded Atlassian users at free events near you!

Find a group

Connect with like-minded Atlassian users at free events near you!

Find my local user group

Unfortunately there are no AUG chapters near you at the moment.

Start an AUG

You're one step closer to meeting fellow Atlassian users at your local meet up. Learn more about AUGs

Groups near you