I am having issues with certain sub-sites on a SharePoint site not showing up in the sitemap0.xml/sitemap_mobile0.xml files that are generated by SharePoint. Some sub-sites show up and some don't for some reason in the sitemap files.
I have a site collection and many sub-sites under the main site. Anonymous Access is enabled for both the Web Application (through Central Admin) and Site Collection are enabled. Search has been configured for the environment and all the pages/sub-site contents show up when searching for them through the Search Box/Search Results web parts. At the Site Collection Level, I have enabled the feature Search Engine Sitemap. I have also run both incremental and full crawls for the SharePoint site (no major errors). The Edit SEO Properties have also been double checked on the pages that don't show up in the SharePoint generated sitemap file and I've made sure that the Include in sitemap and expose to Search Engines option is selected. I've deleted all the sitemaps and regenerated them re-running the Search Engine Sitemap job in Central Admin for the following files multiple times:
sitemap.xml, sitemap_tmp.xml, sitemap0.xml, sitemap0_tmp.xml, sitemap_mobile0.xml, sitemap_mobile0_tmp.xml
And lastly, I've double-checked the robots.txt settings through Site Settings->Search Engine Sitemap Settings and for testing, all I have in there is:
User-agent: *
*So there are no disallows currently.*
I guess I'm not sure what else to check to ensure that all sub-sites on a SharePoint site is included in the SharePoint generated sitemap files. All sub-sites do have Anonymous Access enabled.
Any help would be appreciated and thanks for reading if you got through all of this.