2

I have SharePoint 2010 Enterprise for Internet Sites. Some search results in Google & Bing are pointing to my intranet site URL which is intranet.mysite.com

I want to cloak my site totally from Search Engines.

How to do it?

3

You can add a robots.txt to your root.

in this robots.txt you can put information about what pages may and may not be indexed. For more information check:

http://www.robotstxt.org/

http://www.robotstxt.org/robotstxt.html

edit: waldek mastykarz has made a solution that automatically creates a robots.txt for you: http://blog.mastykarz.nl/generating-robots-txt-files-mavention-robots-txt/

PS: is your intranet anonymous accessible?

  • 3
    remember that SharePoint search itself also checks for robots.txt so you will either have to allow for SharePoint user agent or disallow specific web robots – Anders Rask Jul 20 '11 at 9:27
  • @Bas What do you mean by root? Is it the Login page? – neo269 Jul 20 '11 at 9:54
  • @Bas No it is not anonymous accessible! – neo269 Jul 20 '11 at 12:25
  • 1
    @Saumil Then i think it's strange that your site gets indexed! That should not happen. It's smart to check if it's really not accessible by anonymous users! – Bas Lijten Jul 20 '11 at 12:29
  • 1
    @Anders Rask: that is a very good caveat! Good reminder, that is – Bas Lijten Jul 20 '11 at 12:29

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.