One of my client wants to delegate a user and group management policy to someone (contractor resource) but contractor can't access document library as they have some business related data in the doc lib. as per SharePoint if any user has user management permission, will have doc library and list permission by default.

Please suggest yor views, if anyone face this issue in past.