Questions tagged [crawl-rules]
Crawl rule is a configuration which defines under which condition a content source should and shouldn't be crawled
38
questions
0
votes
1
answer
54
views
exclusion crawl rule
I have a wiki consisting of an url like this: https://mycompany/wiki/pmwiki.php?n=pagename?action=edit
I'm trying to exclude all the actions, so I created an exclusion: https://mycompany/wiki/pmwiki....
- 134
0
votes
1
answer
299
views
Crawl log - errors
I read many articles but I didn't find a solution for my problem.
Our SP 2019 on-prem farm consists of: 2x Application with Search, 2x Front-end with Distributed Cache. Each server have 32GB RAM and ...
- 15
0
votes
1
answer
2k
views
The item was deleted because it was excluded by a crawl rule
My search crawl is not working for my local site.
On my Crawl Log I see a warning:
Item not crawled due to one of the following reasons: Preventive crawl rule; Specified content source hops/depth ...
1
vote
1
answer
388
views
SP2013 Site collection not being crawled for results
I have a site collection on SP2013 that is not being crawled for results.
The Crawler user account is a member of the user policy on the web applications with full read permissions.
I have other web ...
- 439
2
votes
0
answers
117
views
Modified items are multiple times in SP search index
I have a problem with sharepoint 2013 search engine. When I change some item, then in search result old record still display, even after re-indexing items. Not all items behave in this way (mostly ...
- 139
0
votes
1
answer
44
views
Remove domain web adress rule in search scope using powershell?
This is what we do to remove a rule from a search scope:
$scope = Get-SPEnterpriseSearchQueryScope -Identity $scope -SearchApplication $ssa;
Get-SPEnterpriseSearchQueryScopeRule -Scope $scope -Url $...
- 736
1
vote
3
answers
493
views
crawl delete all files in content source as file share
Crawl log content source as file share like this image:
No errors, no warnings, what is deletes? Files are xml, dll, sys, exe format delete
Finally nothing show in results!
When reset index and ...
- 185
0
votes
1
answer
176
views
Changing a Crawl Rule, must I do a full crawl to update the change
I made a crawl rule change that should impact a document library and cause some new documents to be inserted. However since it's a smallish change, and a full crawl can take awhile on our site (half ...
- 1,671
0
votes
1
answer
715
views
how to crawl pdf documents in sharepoint 2010 search
How to crawl pdf documents in sharepoint 2010 search,i added a content source but when i search for pdf documents i can not found pdf documents except all documentes,before cumulative updates it was ...
- 2,955
0
votes
1
answer
956
views
SharePoint 2013 new crawl rule using ADFS login
I'm trying to setup my SharePoint search service application to use ADFS authentication when performing crawl of specific source.
On the following URL in CA i'm adding new crawl rule:
http://server:...
- 528
0
votes
1
answer
30
views
Crawl Search SharePoint 2007
On our Crawl Rules we have excluded the following:
*://*allitems.aspx
*://*editform.aspx
*://*dispform.aspx
*://*my-sub.aspx
*://*mod-view.aspx
However on our search result it's still included, ...
1
vote
2
answers
1k
views
Crawl rules - Do exclustion rule make crawl faster?
I am seeing thousands of warnings in my crawl log for a login page for a public website that is using a complex URL.
Is there any benefit then to create an exclusion crawl rule for this login page ...
- 236
1
vote
1
answer
413
views
Excluding items from a crawl based on properties
We have a 2013 farm that is crawling a 2007 content source with a lot of outdated content in it. We'd really like to exclude items from the crawl based on their last modified date, but we're having ...
- 2,680
1
vote
1
answer
785
views
Crawling only a certain file extension
I am crawling a SharePoint 2007 site from SharePoint 2013 farm including a lot of folders and different file types. Only the PDF files are relevant to search. The crawl is very slow and I am ...
- 11
0
votes
0
answers
479
views
Is anything bad on exclusion crawl rules in SharePoint 2013?
Using SP2013, we have disputation on using crawl rules to handle application specific requirements within an on-prem farm.
I'm providing an application (site collection with features) that contains ...
- 220
1
vote
0
answers
387
views
How to create crawl rules to exclude root folder content but crawl subfolders
I've been trying to crawl an external site using SharePoint 2010 in which I'm only interested in crawling results for the content stored in various subfolders underneath a root path.
The root path is ...
- 121
2
votes
0
answers
379
views
Change the search result item itself in display templates -SharePoint 2013
I have a document set with 2 documents , lets say Document A (Content type A) and Document B(Content type B). All the properties of the document set are marked as shared properties. Now i want to use ...
- 8,809
1
vote
2
answers
426
views
How to Skip Sites with No Access from Sp2013 Search Crawls
I have about 56 different Sites in our site collections that are set to No access. Every time Search Service Crawl hits those sites it prompts us with:
Access to this SharePoint site has been blocked....
- 2,146
3
votes
0
answers
1k
views
Disable search on file content
I have to refine my search schema to not search for the content of files (e.g. Excel file). I only want it to search for the metadata I have defined for the files.
How do I do this? There are tons of ...
- 173
2
votes
2
answers
4k
views
Using crawl rules to exclude Allitems.aspx, DispForm.aspx
Is anyone having any idea on how to exclude List Forms from Search result.
I tried lot many things suggested on google, but none of them seems to be working.
- 2,019
1
vote
1
answer
506
views
SharePoint 2010 Fast Search not crawling complex urls
So I'm working with a client that is using Fast Search to crawl a SharePoint 2010 Publishing site. For the most part it is working fine, except they have "news" and "events" pages that are ...
- 4,982
1
vote
1
answer
866
views
Crawl Impact rule vs Crawl rule, Exam question 70 - 667
Can someone confirm if am right for this question as I tried two practising exams and they both are giving me "Wrong answers"
You have a sharepoint server 2010 sp1 server farm.
You have a ...
- 9,250
0
votes
1
answer
849
views
Sharepoint Search, ignore a list column from searching
I've created a custom search, using scopes.
There is smth, that I don't want the search to index a specific column of a list.
How can I ignore this column from being searched
- 487
2
votes
4
answers
2k
views
url exclusion in SharePoint crawl rule not working
I don't want "AllItems.aspx" to appear in sharepoint search results from any level/ folder. So I created new crawl rule http://.*/forms/allitems.aspx and checked the regular expression check box. ...
simran
0
votes
1
answer
1k
views
SharePoint 2010 Crawl Rule Regular Expression Exclude Specific String
I'm trying to figure out the correct regular expression for excluding a specific URL string within a SharePoint 2010.
This is the scenario I'm trying to figure out is the following:
I was to crawl ...
- 75
2
votes
1
answer
2k
views
Can you create crawl rules for file:// urls?
In configuring our search service, we have set up a content source of \\server\projects. Within this source is a directory, \\server\projects\~backups. This backup directory contains hourly, daily, ...
- 123
0
votes
1
answer
142
views
Search Scope Definition for [(a OR b) AND (c OR d)]
Using SP2010 I would like to define a search scope where documents are located in two locations. The results should only include two specific file types. What I want is
(Folder = "a" OR Folder = "b") ...
- 1
1
vote
0
answers
2k
views
Search crawler indexes only top-level site collection
We had to redesign and redeploy our web applications, but we didn't want to loose all the data. So we detached all content databases from applications, removed web applications, recreated properly and ...
- 1,547
10
votes
1
answer
2k
views
Search scopes have too few items
This is a difficult question
I am trying to figure out how SharePoint 2010 Search and Scope works. I have a site that contains 369 sites, and 5563 total pages within those sites. The sites are all ...
- 1,252
1
vote
2
answers
706
views
I would like to CRAWL ONLY SPECIFIC ITEM/DOCUMENT to FAST Search Server 2010? Programatically?
I would like to Crawl particular Item. To the FAST Search Server. I don't wanted to do Incremental/Full Crawl.
I can write event Handler when new Item and Check for Specific condition. If the ...
- 21
3
votes
1
answer
2k
views
Search shows results for /Pages/foldername AND /Pages/foldername/default.aspx
I'm finding that my SharePoint 2010 search results are showing results for both a folder and that folders default.aspx page. For example, my results can look like this:
products
<description taken ...
- 1,252
2
votes
2
answers
3k
views
search results not including pages within folders
The site I'm working on uses folders inside the Pages library (yeah, I know and agree.. but they pay the bills). When searching for key terms, I'm not getting the pages within these folders in my ...
- 1,252
0
votes
1
answer
3k
views
How to limit crawl on specific site collection?
Need some guidance on how to limit crawl. I have a site collection that I will create it's content source. However, I want to make sure this site collection is not being crawled by the main content ...
- 382
2
votes
2
answers
582
views
Excluding FBA users from people search
I've got a mixed environment with both AD users as well as FBA users. The FBA users are stored in a seperate ASP.NET membership database.
Now when I use search, both AD and FBA users show up. I'd ...
- 1,264
0
votes
2
answers
543
views
SharePoint Crawl Rules
I am trying to setup some specific crawl rules , I have a local site that is being indexed
http://mylocalsite
and I only want to index files under a certain location such as http://mylocalsite/...
- 33
3
votes
3
answers
3k
views
Why do I get "The underlying connection was closed." when I try to enter form credentials for a crawl rule?
When I'm setting up a crawl rule, I check 'Specify form credentials', wait a minute and then get an error message:
An unexpected error was encountered while trying to connect to https://site.org/...
- 1,190
1
vote
1
answer
806
views
SharePoint Search Overriding Crawl Rules
Is there a way to override a crawl rule in SharePoint 2007 Central Admin? For example, if I have a site and I only want users to see content from http://www.mysite.com/sites/portal in search results, ...
- 402
2
votes
2
answers
1k
views
Only crawling a content source for files with a given extension
I want to index only the files with a specific extension "*.las". I know that there are less than 20K of these files and there are a total of over 1 million files in the containing fileshare.
I've ...
- 81