Tell me more ×
SharePoint Stack Exchange is a question and answer site for SharePoint enthusiasts. It's 100% free, no registration required.
up vote 2 down vote favorite

I have SharePoint 2010 Enterprise for Internet Sites. Some search results in Google & Bing are pointing to my intranet site URL which is intranet.mysite.com

I want to cloak my site totally from Search Engines.

How to do it?

share|improve this question

1 Answer

up vote 3 down vote accepted

You can add a robots.txt to your root.

in this robots.txt you can put information about what pages may and may not be indexed. For more information check:

http://www.robotstxt.org/

http://www.robotstxt.org/robotstxt.html

edit: waldek mastykarz has made a solution that automatically creates a robots.txt for you: http://blog.mastykarz.nl/generating-robots-txt-files-mavention-robots-txt/

PS: is your intranet anonymous accessible?

share|improve this answer
3  
remember that SharePoint search itself also checks for robots.txt so you will either have to allow for SharePoint user agent or disallow specific web robots – Anders Rask♦ Jul 20 '11 at 9:27
@Bas What do you mean by root? Is it the Login page? – saumilm Jul 20 '11 at 9:54
@Bas No it is not anonymous accessible! – saumilm Jul 20 '11 at 12:25
1  
@Saumil Then i think it's strange that your site gets indexed! That should not happen. It's smart to check if it's really not accessible by anonymous users! – Bas Lijten Jul 20 '11 at 12:29
1  
@Anders Rask: that is a very good caveat! Good reminder, that is – Bas Lijten Jul 20 '11 at 12:29
show 1 more comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.