Farm: SharePoint Server 2010
This farm uses Remote Blob Storage (Storage Maximizer by Dell)
I'm doing a full crawl of a content source with approximately 1.4 million items in it. All items are marked as successfuly crawled for the first 650,000 or so items. After that, I start to see event id 114 in the Windows event log indicating the Search Gatherer cannot reach the server. Once that appears, every item is marked as an error when it is being crawled.
The exact message:
"The server xxxxxxxxxx is unavailable and could not be accessed. The server is probably disconnected from the network. Items from this server will be skipped by the crawl for the next 10 minutes"
I can resolve to that URL from a browser session on the crawl server where the error is being thrown. I say this to state that the URL is in fact available from that server. Note: the hosts file on this crawl server is pointing to itself for this URL.
I've reset the index and initiated a full crawl 3 separate times. Each time this error starts after its successfully crawled over a half million items. Thinking this might be resource-related, but not sure what to look at.
I have a Windows Server admin watching disk, memory, CPU but he doesn't see anything abnormal.
Any ideas what could be causing this issue?