SharePoint Stack Exchange is a question and answer site for SharePoint enthusiasts. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

The search results webpart has a boolean property which can be used to configure whether "duplicate" results should be returned.

Looking at documents, when is a document A considered to be a duplicate of document B? Does the content of the file need to be identical?

Also, is there a way to use the SharePoint Object Model to indentify duplicate documents?

share|improve this question

Only ½ an answer here (ill ask Lars Fastrup to opt in): I seem to remember from last time i looked at IFilters that the ifilter extract the text from the document and that the comparison is done by checking similarity of two texts. The keyword here being similar, not identical. How the this is determined im not sure...

For what i know the only thing the object model has to offer is the same as is exposed in the search web part: an FullTextSQLQuery has a boolean TrimDuplicates property, that lets you include duplicates or not.

hth Anders Rask

share|improve this answer

I'm not sure how the duplication is identified, but in my experience it works remarkably well. I have seen several cases in which very simlar documents were identified as duplicates. The content was almost identical but the formatting had been changed.

share|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.