Try creating a view. Navigate to that view, and "Edit" the page. Then, edit the List View Web Part, expand advanced"Advanced", and add your audience. This does not hide the view in the dropdowndrop-down however.
If you create this based on a personal view this wont be an issue as the users without the appropriate permission can
twon't be an issue as the users without the appropriate permission can't select this view from the View dropdown.