Questions tagged [crawling]
Crawling websites or other locations (like exchange and file shares) to build a search index. Done by the SSP in MOSS/WSS 3.0 and by the Search Service Application in SP2010.
308 questions
1
vote
1
answer
415
views
Excluding items from a crawl based on properties
We have a 2013 farm that is crawling a 2007 content source with a lot of outdated content in it. We'd really like to exclude items from the crawl based on their last modified date, but we're having ...
- 2,680
2
votes
2
answers
2k
views
SP 2013 Search does not uniquely index friendly URLs that point to the same physical page
I have an on-premise SP 2013 farm that I will be using to host a Internet (public-facing/anonymous) site. I'm using managed navigation with term-driven pages. Three of my navigation links point to one ...
- 621
1
vote
1
answer
2k
views
Deleted site collections showing in search results after multiple full crawls
I am experiencing an issue where search results are showing deleted site collections after multiple full crawls. I've been searching around and trying different things, but so far nothing has worked.
...
- 113
1
vote
2
answers
1k
views
SharePoint 2013 slow Full and Incremental crawl
This is my setup:
2xSQL, 2xAPP, 2xWFE where;
SQLs is 16GB ram
APPs are 12GB ram
WFEs are 12GB ram
C: 40GB
Log: 50GB
Index: 50GB
Search is running on one of the APP servers, and Requests are on ...
- 324
4
votes
3
answers
2k
views
I don't want to crawl/show Document content for Sharepoint search
I have a Sharepoint Document repository site, but when I am typing anything on the Search box, not only it searches for Files and Folders it also searches the document content and returns the ...
- 121
0
votes
1
answer
1k
views
Pipeline did not respond within the appropriate time
I can't get the search to work, someone has an idea of what may be the cause?
On the crawl log, I see this message.
Errors: 3056 "pipeline did not respond within the appropriate time"
Success: 12
...
- 43
0
votes
1
answer
711
views
Error while crawling LOB contents in SP 2013:Could not find default endpoint references contract in ServiceModel client configuration section
I created BDC Model in SharePoint 2013 using Visual Studio 2013. I am retrieving data from external data source using Web Service in ReadList method. Using this external content type (BDC Model) i ...
1
vote
1
answer
795
views
Crawling only a certain file extension
I am crawling a SharePoint 2007 site from SharePoint 2013 farm including a lot of folders and different file types. Only the PDF files are relevant to search. The crawl is very slow and I am ...
- 11
2
votes
2
answers
5k
views
Clean up search index. Remove orphaned crawled and managed properties
It's obvious. Resetting the search index clears all search results. It does however not remove all crawled and managed properties. SharePoint (2013) remembers them forever.
The only option to remove ...
- 467
1
vote
0
answers
71
views
SharePoint 2007 crawler is not stopping
I recently tried to start a full crawl after my colleague mentioned that some of the files are not visible in the search.
Normally the crawler start full crawl every week. so i manually tried to start ...
- 147
1
vote
2
answers
556
views
Full crawl on 1 site collection stuck after 137 success items and 2 errors
I am using SharePoint 2010 and FAST search. I have created a new content source with 1 site collection. This site collection is new and I created only 2 items inside a list. I started a full crawl for ...
- 4,385
2
votes
3
answers
6k
views
Search Crawler filling up drive, continuous crawls do nothing
Our Central Admin server (also the crawler) is limited to 60 GB on the system drive (where SharePoint is installed).
Initially, a full crawl ran without issue and took minutes. We were happy with ...
- 351
1
vote
1
answer
204
views
Managed Metadata allow mulitple values cannot be crawled
I am using SP2013 on-premise. On a site collection's Pages library there is a Managed metadata column "Wiki Category" and allowed mulitple values. At the same time I have enabled multiple values for a ...
- 4,075
2
votes
1
answer
153
views
Sharepoint 2010 - index crawl of uploaded documents
Short version of question - Does the index crawl through the content of uploaded documents, and if so, can that be turned off?
Longer version - I have a site consisting entirely of uploaded PDFs of ...
- 265
1
vote
1
answer
96
views
Crawling external database with security trimming
We have a legacy records management system that we want to index in SharePoint 2013. We just want to index it and leave the documents where they are.
The records management system of course has a ACL ...
- 1,057
1
vote
2
answers
101
views
Web server requirements for being crawled
I'm trying to index a web site that is hosted on a separate server in the domain but every time the crawler runs it returns a ball of warnings and errors the first time, and then the server becomes ...
- 2,680
1
vote
1
answer
565
views
FAST search: Search crawled succesfully, but I still do not see new search results, I think index issue
I am using SP 2010 and FAST search. I have 2 FAST search servers and 2 front end servers and 2 app servers. I do every 4 hours an automatic incremental crawl. I do not have an automatic full crawl ...
- 4,385
0
votes
2
answers
391
views
Crawl Sharepoint 2013 site as a regular web site
I've created a "branding" site with Sharepoint 2013. I'm not being able to configure the search engine so that it finds the content from the custom web parts. Most "static" content (institutional ...
1
vote
0
answers
397
views
How to create crawl rules to exclude root folder content but crawl subfolders
I've been trying to crawl an external site using SharePoint 2010 in which I'm only interested in crawling results for the content stored in various subfolders underneath a root path.
The root path is ...
- 121
1
vote
0
answers
365
views
SP2013 crawling not include subfolder and item below
In our SP2013 farm, we are using continuous crawling. The content source is setup to crawl entire web application. No rule is set.
In one of new added site collection, there is a default "Pages" ...
- 4,075
0
votes
1
answer
46
views
A content not crawler in SP2007 search service
we have a SP2007 search service attached to our SP2007 server used to create and store some PDFs.
Every night an incremental crawl job starts, and everything works fine... but some night ago (4 sept ...
3
votes
1
answer
2k
views
SharePoint 2013 how to disable crawling document content
SharePoint 2013 foundation How to disable crawling document content. The search result is returning way to much information for my users. Need to crawl only metadata (columns) and file name.
0
votes
1
answer
4k
views
Search and index pdf files as attachment in a List Item
Does SharePoint 2013 Search find pdf files that have been attched to usual SharePoint list item. do they be indexed?
- 2,086
3
votes
1
answer
5k
views
Incremental Crawl not running as scheduled (Sharepoint 2013)
I scheduled my incremental crawl to run every 5 minutes. However, it is not running. It should crawl by 5:55pm, but it didn't. Any advice?
Thanks!
This is the settings page.
- 73
0
votes
1
answer
239
views
SharePoint 2013 run both Continues and Incremental Crawl
As per the MSDN article http://technet.microsoft.com/en-us/library/jj219802(v=office.15).aspx
A continuous crawl does not process or retry items that return errors more than three times. A "clean-...
0
votes
1
answer
1k
views
How can I index a custom column in SharePoint 2010 FAST search?
I am using sharepoint 2010. I have created a document library. Inside this library I am using a custom content type. In this content type I have 3 custom columns like (Company name, Company address, ...
- 4,385
7
votes
1
answer
12k
views
Find an item, search multiline text
I have a SharePoint list that contains multiple fields. One of which is a multiline "Notes" field that is not included with the default view. When I perform a search on the list, I can search on any ...
- 173
1
vote
1
answer
4k
views
Search results not includes custom fields
I have content type on my site with 3 custom columns defined:
"Corporate sponsored" - Single line of text column
"Country" - Yes/No column
"Customer Name" - Managed metadata column
This content type ...
- 11
0
votes
1
answer
572
views
How to get ".sql" files to be searchable in SharePoint Foundation 2013?
What sort of black magic and secret handshakes do I need to do to get .sql files searchable with SP Foundation 2013?
Specifically, how do I get files with the ".sql" extension be both indexed and ...
- 371
3
votes
1
answer
7k
views
SP 2013: The item has been truncated in the index because it exceeds the maximum size
Our crawler shows the following warning:
The item has been truncated in the index because it exceeds the maximum size. ( Item truncated. Field=docacl, Occurrences=3094,
Chars=524453.
It concerns ...
- 91
1
vote
2
answers
3k
views
The item could not be indexed successfully because the item failed in the indexing subsystem
I'm trying to find an explanation of the crawl error "The item could not be indexed successfully because the item failed in the indexing subsystem.". I get a lot of these when indexing a file share. ...
- 63
0
votes
1
answer
3k
views
Unable to create indexes on Sharepoint Online lists with more than 5000 records
I am assisting a friend by moving him from managing a business entity from Excel to Access. Because he desires the data to be viewed/edited from multiple locations, I suggested a MS Access database ...
- 1
1
vote
1
answer
303
views
Search Crawl error on a single page
This is a SharePoint 2013 Enterprise environment. The crawler refuses to crawl a single page correctly. No other errors show up in the crawl log and every other page is crawled correctly. The error ...
- 2,612
0
votes
1
answer
609
views
Best practice to manage content source and crawling on VM
I am using SP2013 standard and have two web applications. One app (http://blog.domain.com solely for My Site Host) and another app (http://web.domain.com) for the other type of site collections.
I ...
- 4,075
1
vote
0
answers
188
views
A weird reaction to 'if-modified-since' header
What's the reason that SharePoint 2013 may process 'If-Modified-Since' header value in an invalid way?
Case:
I have a file A.txt in a list;
I download the file and see the date XXX in Last-Modified ...
- 173
2
votes
2
answers
158
views
Dedicated Server per content Source
I have a question which I'm not sure can be achieved. Take note that I'm not a SharePoint Search specialist.
We have multiple content sources. Everything is running fine.
Recently, we added a new ...
- 2,676
0
votes
1
answer
134
views
Crawl .config files
I have a fileshare with several thousands .config files (xml files) - and several thousands of other files.
I added the .config files to the allowed file-types and restarted search.
Apparently the ...
- 2,539
0
votes
1
answer
287
views
sharepoint 2010 and tagcloud
Having issues with crawling and tag cloud. Is it a requirament to run full crawling in sharepoint 2010 every time, when i add a new document with tags? I tried incremental, but afrer that new tag ...
- 13
0
votes
1
answer
249
views
In SharePoint 2007 document is crawled but not coming in the search result
What to do when documents are getting crawled but not coming in the serch result.
I have checked the crawl log and I can see those documents are successfully crawled but in the search result those ...
- 275
1
vote
1
answer
13k
views
2013 Content Index Reset Timeout
I'm having a problem when I try to reset the content index in SharePoint 2013.
When I try to reset the index from the 'Search Administration Page', the page hangs for about a half-hour then returns "...
- 23
4
votes
1
answer
371
views
What happens to the current Search crawl when the timeout is reached?
I've got a question and can't find a answer on Technet.
We have search crawls setup to repeat within the day. The configuration looks like this:
My question is:
Basically, that means that the ...
- 2,676
5
votes
2
answers
1k
views
Does Continuous crawl start a new crawl on each uploaded document while uploading multiple documents at the same time?
Reading Exam Ref 70-332: Advanced Solutions of Microsoft SharePoint Server 2013, I made the following finding:
Enabling continuous crawling means that search results can appear before a crawl is ...
- 25.5k
10
votes
2
answers
3k
views
Search 2010: Exclude dispform.aspx from search without excluding content?
Our index is bloated by thousands upon thousands of identical /DispForm.aspx? results, but there doesn't seem to be a way of excluding these without also excluding the content contained within the ...
- 433
3
votes
1
answer
1k
views
Site collections as content sources?
We have a particular site collection that is becoming a problem (with huge amounts of content, large lists etc), and it is massively interfering with the indexing process. Whilst ideally we would sort ...
- 433
2
votes
2
answers
3k
views
2010 crawl - "Item was not crawled because of a password change"
Our Sharepoint servers were shut down safely as part of a backup, and when brought back online we noticed multiple errors in the crawl log, and no successes.
The error was "The account password was ...
- 433
2
votes
2
answers
302
views
Scaling out Search Crawl service
I have a large content database on a Sharepoint 2010 site collection (130GB).
The search crawl component which has a job to index items in the site collection is taking too long and in the process ...
- 531
2
votes
1
answer
1k
views
How do draft item security affect indexing for search?
Some info:
In my SharePoint 2010 environment I have set the "Draft Item Security" to "Only users who can edit items". The search service account have Full Read permissions and should be able to index ...
- 1,315
14
votes
8
answers
21k
views
SharePoint 2013 Full Crawl never stops
I have set the following inside the content sources:
Incremental crawl to be every 20 minutes
Full crawl: At 1:00 every day.
When I first set this it was working well, the incremental crawl take ...
1
vote
2
answers
2k
views
Crawl files with no file extension
Here is an interesting problem I cannot seem to find an answer to. I have a client that has several files from email message exports that do not have a file extension (e.g. PDF, DOC). These files, ...
- 554
-1
votes
1
answer
998
views
Do I need a Full crawl search, if i am having an incremental crawl every 20 minutes
I have set an incremental crawl rule to execute an incremental crawl every 20 minutes. But my question is do I need to perform a full crawl, beside the incremental crawl ?
Regards