0

I have a document library inside SharePoint where the document library contains 1 million documents. Each document has an expiry date.

Now I want to create a scheduled flow which runs daily and get all the documents which have their expiry date = Today.

Now it is expected that the documents which have their expiry date = Today will be more than 5,000 items.

So can anyone guide me on how can I implement this inside the scheduled flow? If I want to do so using CSOM, I would do these steps:

  1. CAML query to get the document which have their expiry date = Today + Implement paging to avoid the 5,000 threshold issue.

So inside Power Automate, how can I implement this?

1 Answer 1

2

SharePoint REST API returns maximum 5000 items in one API call. In Power Automate flow, there are few ways to get more than 5,000 items:

  1. Using Pagination (from action settings) - This setting is specific to few actions
  2. Using the Do Until method

You can find detailed steps for above methods in below articles:

  1. How to get more than 5000 items from SharePoint Online in Flow
  2. Get more than 5000 items from SharePoint with Power Automate

Also, there is limitation on how many items will be returned using pagination. It is based on the license/plan profile you are using:

enter image description here

For detailed limitations of Power Automate flows, check below documentation: Limits for automated, scheduled, and instant flows

5
  • thanks for the helpful reply.. so since we have 1 million records, so what i am trying to achieve is not supported inside Power automate.. and it will be easier to writ CSOM code inside console application that run daily i do the data retrieval and checking ?
    – John John
    Commented Jul 4, 2021 at 7:42
  • any advice on my above comment?
    – John John
    Commented Jul 4, 2021 at 7:53
  • (Maximum) How many expired items/documents will be returned at a time? And Yes, it should be easier to retrieve more items using CSOM/console application as you will have more control using programming. Commented Jul 4, 2021 at 7:59
  • 1
    in the near future we could have 5,00,000 items in one report..
    – John John
    Commented Jul 4, 2021 at 8:11
  • Hi @johnGu, Please Upvote(^) and accept as an Answer as it helped you & it will help others with similar question in future to find the correct answer easily. It also removes this question from "Unanswered questions" list. Commented Jul 15, 2021 at 9:49

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.