Upon deletion of a site or document, I'd like the site/document to be deleted from everyone's "follow" list. However, it appears that is not happening. I've confirmed the "Activity Feed Timer Job" is functioning normally.
This is SP On Prem 2013
You could create an event receiver to achieve it.
When the site is deleted, then it unfollows the site.
There is a similar post: