I have a list with ~250,000 items in it and I know that I've a lot of duplicates which I need to identify then clear out.
I don't want to write Server Side code so looking for a imaginative solution.
"Export to Spreadsheet" and Datasheet don't work as they fall foul of List View Threshold limits.
I have written some JSOM that enumerates through all the items, but then checking if each item has duplicates is just way too slow and resource intensive.
Does anyone have any idea how I can identify duplicates (in a URL column)? If I can get the list data out to Excel then I would be sweet.