I have an oft doc linked in SharePoint. What I want it to do is open this oft doc in outlook. What its doing is prompting to save it in the download file. Is there anyway I can prompt outlook to open when they click on the link?
It's not going to open it in Outlook. They have to download the file first and then follow the steps in the provided link based on what version of Outlook they are using. Sorry to bust your bubble.
You can add a MIME type to IIS to allow this file type to open in its respective client application.
Here is a quick summary I found: https://kerseub.wordpress.com/2012/04/23/add-new-file-type-in-sharepoint/