Forums

Articles
Create
cancel
Showing results for 
Search instead for 
Did you mean: 

How to hide all URL from crawlers

serge calderara
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Leaders.
June 8, 2021

Dear all,

Our customer is hosting Atlassian Jira instance in Azure and authenticating using SSO and MFA authentication from Azure AD feature.

The question we have is what is the proper way to fully hide Jira ALL jira instance URL from Crawlers , even the root instance url

Actually we notice that our datacenter version 8.16 includes a default robots.txt files with following settings :

File is located at : /opt/atlassian/jira/atlassian-jira/robots.txt

Content is defined as :

User-agent: *

Disallow: /sr/

Disallow: /si/

Disallow: /charts

Disallow: /secure/ConfigureReport.jspa

Disallow: /secure/ConfigureReport!default.jspa

Disallow: /secure/attachmentzip/

 

Does this default content is enought to hide all urls in our configuration ?

Or do you use something else.

Thanks for sharing your best practices and proven results that you have in place

regards

0 answers

Suggest an answer

Log in or Sign up to answer