Hot answers tagged crawl
3
You have several options of excluding content in SharePoint:
Crawl Rules
tag
Search Scopes
robots.txt
custom code to exclude content
"noindex" tag (--> warning will still make SSRS requests, only not index the content)
1. Crawl Rules
You say you don't want to use crawl rules as you have many pages you would have to exclude. Fine.
2. tag
With the ...
1
The issue seemed to be down to the size of the Index Partition. We reduced the number of items in the index using crawl rules and were able to get it down to about 8 million items from 12 million.
We were able to then make changes to the search topology.
What was interesting was the SharePoint Search Service on the rogue Crawl server would take about 90 ...
1
This issue was fixed in the SharePoint 2010 April 2012 Cumulative Update package:
Issues that this hotfix package fixes:
Changes on the Home.aspx page are not crawled through an incremental crawl in SharePoint Foundation 2010.
Don't get confused by the description only mentioning Home.aspx, which relates to Wiki pages. I have ...
1
It depends on so many factors. Server configuration, amount of data to index specific settings for the content sources/scopes. Be very careful though when setting your content sources. I once had a client set their search to follow links. They had linked to their internet site and then had links from that to other sites. When they finally asked me to take a ...
1
The performance of search will depend on a few things
Size of target being crawled, bigger it is the longer it'll take, naturally. Also, the performance of the target, if pages are loading slowly, search will run slower.
Your farm infrastructure: services per server and server performance. How is your farm setup? Is search running on its own server or ...
1
As you stated in your last update, checking for useragent is an option.If the user agent contains MS SEARCH, the rendering is stopped. This works (tested) in SharePoint 2007 and 2010.
if (!string.IsNullOrEmpty(Request.UserAgent))
{
if (Request.UserAgent.ToUpperInvariant().IndexOf("MS SEARCH") > -1)
{
return;
}
}
Only top voted, non community-wiki answers of a minimum length are eligible