Why wouldn't SPD just show me all of these? It seems convoluted that I have to access the forms in this way. I can't access allItems.aspx in any other way, unless you guys know another.
Actually, on the first image that you posted, the forms are separated from the views. You're looking for a view, so you should look at the top right of the page. It's just a way for SPD to organize pages according to their usage.
You can also view all the forms/views together if you click "All Files" from the left navigation in SPD, then click the name of your list/library, then click Forms. So you don't really need to open SP for that.