Update robots.txt on hosted Confluence site

[Eric Farr]

Hi,

How do I modify my robots.txt file on my hosted Confluence site. I want to leave the site public, but remove it from search engines.

Thanks!

[Nic Brough -Adaptavist- · Accepted solution]

I'm not sure Atlassian will do it, but it can't harm to ask (let us know if they do do it!).  Raise a support request at https://support.atlassian.com

[rrudnicki]

Hi Eric, 

robots.txt shouldn't block the access to your site, that only won't index your site on search engines, but you should be fine to access that if you know the URL to your site. 

I believe this documentation can be useful:

https://www.koozai.com/blog/search-marketing/a-brief-guide-to-robots-txt-and-five-mistakes-to-avoid/

https://developers.google.com/webmasters/control-crawl-index/docs/faq?hl=en

https://confluence.atlassian.com/jira/using-robots-txt-to-hide-from-search-engines-185729512.html

Regards, 
Renato Rudnicki 

[Eric Farr]

Thanks, Renato. I'm not looking to block access to the site. I just don't want my Confluence pages to show up in Google searches.