We are building a SharePoint application where an external system will upload data into SharePoint list using REST APIs. The volume of data in the list would be high and it would go above 5k items in near future. The external system would also have to query the data already in list (again using REST API) before uploading it so that they don't upload duplicate data.
One pitfall I can see is that when the list goes above 5k items the REST API will stop working to filter the data. I am not sure if there would be any problem in adding any data using REST API in a list with more than 5k items.
So here are my queries:
- Is there any way we can filter a list (with REST API) with more than 5k items in it?
- Will there be any issue while adding data to list using REST API when the list has more than 5k items?
- In this scenario is SharePoint list a good option or SQL server be considered?