yes, you are right. Filtering with indexed columns is one way to do it.
You have to optimize each view if you want to continue to use it. LVT actually says it, it's the List View Threshold.
A list can have much more items, but a view MUST NOT have to use more than the threshold on items. And here, it is not sufficient to set the item limit to less than the LVT, you also need to take care, that e.g. for sorting and filtering, you use only indexed columns.
E.g. as long as you only sort by ID (which is always indexed) and have no filter, grouping or any other non defaults configured and you have set item limit (= paging) to less than LVT, your view should work, even if the list contains much more than 5,000 items.
Please find here a relevant presentation on this topic:
--> Starting with slide 23, it gives some tips how to set up views in lists with items > LVT.
Below is a link with some Microsoft information on this topic: