We have lots of errors in Crawl Log about accessing one type of applications on URL.

I am getting an error message:

An unrecognized HTTP response was received when attempting to crawl this item. Verify whether the item can be accessed using your browser.

for URLs where the project ID is only changing:

and I want to create Crawl Rule, but haven't figured out the right formula for it.

Thank you for suggestions and ideas.

2 Answers 2


So you're looking for the RegEx to filter out URL's like the above where only the ID changes?

Try this, with the "use regular expression syntax for matching this rule" option checked.


If there are sometimes more than two digits you might use this instead.


Explanation: the important part is the \d+ or \d{2}, which matches with "one or more numbers" and "exactly 2 numbers", respectively.

Adding a Crawl Rule in Central Admin

  • It should be work, but it doesn't. I don't know why, I tried lots of expressions for excluding this path but nothing didn't work at all. Maybe the problem is somewhere else, but thank You for response. Jan 11, 2019 at 8:23

Is app.company.com a sharepoint server or other? And, did you try the suggestion that was provided? Use run-as to run the browser as the same account as the account the crawler is using, and try to access the site. Do this from the SharePoint server to confirm there are no routing or firewall issues.

  • It's a SharePoint Web Applications and the TBase is provider hosted application which redirecting to the application itself on another url. I only need to create the exclude formula. Jan 10, 2019 at 14:14

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.