I am trying to configure my environment, but am confused about which option to use for my search, Continious Crawl or Scheduled Incremental Crawl?
What is the real difference?
SharePoint Stack Exchange is a question and answer site for SharePoint enthusiasts. It only takes a minute to sign up.Sign up to join this community
Incremental Crawls are search crawlers that gather the changes made since the last crawl. Incremental Crawls and Full Crawls cannot be run in parallel. They take charge and hog the whole crawler resource. This also makes it possible to have very outdated search results. An incremental crawl may not pick up changes that happen while the incremental crawl is running. Continuous Crawl fixes this problem. It may spawn several sessions in 15 minute intervals, that will pick up the changes as well as the changes made during the Continuous Crawl. It will maximize the freshness of your search content.
There is an excellent write up that explains the what's how's and why's of Continuous Crawl. http://blogs.technet.com/b/tothesharepoint/archive/2012/09/14/how-can-i-achieve-the-best-freshness-of-search-results-introducing-continuous-crawls-for-sharepoint.aspx
To elaborate a little... Let's say you have content changes constantly. It will take a little more than 15 minutes to process those changes. For each incremental crawl run that happens, the freshness of content decreases and decreases because the crawler needs to catch-up, but the content is getting updating faster than the crawler can crawl them. Thus will eventually lead to incremental crawl #7 will be updating content that was made during incremental crawl #5, as long as the content output continues. Once the content output slows, then the incremental crawl will catch-up. The interval doesn't matter here also because the incremental crawl will take the time it needs to finish, usually causing more than the interval.
Continuous crawl is created to try to help keeping your search index more up to date. The problem with incremental crawl is that only one can run at a time (for a content source) and it only updates the index when it's done.
Multiple continuous crawls can run at the same time (for the same content source) and they update the index continuously.
The main difference occurs if you sometimes have a burst of updates on content which it may take a long time to crawl.
For incremental crawl then it looks like this:
So all the updates after 2 are first available after 11.
For Continuous Crawl it looks like this:
The updates from 3 will be available as the Continuous Crawl from 4 get to it and updates the index.
A short summary of differences: