I'm looking for suggestions on how you would approach validating metadata on millions of documents that are spread across 10+ site collections.
All of the documents are tagged with metadata.
On-prem farm.
The system of record is a SQL table.
Currently PowerShell is used to set/update metadata on documents.
I can reuse some of the logic from the existing PowerShell set/update script but looping through ~100k SQL rows one at a time sounds really slow.
Would SharePoint batch processing + some sort of multi threading be a good idea?
When processing this much data, would there be any advantage to creating a .Net solution Vs. PowerShell?