I've created a document library inside a SharePoint Foundation 2013 site. I have broken inheritance to the folder and assigned a single user. However, everyone in the company can still access, modify, rename, delete, everything in the document library. Doesn't make any sense.
I've even gone as far as removing everyone from the permissions of the document library, and it still allows everyone into it.