I have to restrict _layouts pages from SharePoint site for all users(except one group). Please suggest me the solution. I am using sharepoint 2013 on premises.
I would recommend not to, since you will effectively restrict users from viewing Sitce Contents of the site, which is located here: http://SPSite/_layouts/15/viewlsts.aspx
But if you have to, add the groups you want to restrict to a new Policy for the web application, and deny "view application pages,..." which is explaind in detail in the article Preventing authenticated visitors from browsing system pages
There is the ability to restrict access to most all capabilities in SharePoint using the Permission Levels.
You can strip out all of the permission to the Site and Lists to limit what your users can see.