What are the server configurations (hardware, and SP Services running on them).
You could be getting a lot of traffic, or if your running services on there like search or excel, they could be tying up your memory.
You can review the monitoring guide and start up some counters to watch what is happening
http://technet.microsoft.com/en-us/library/ff758658.aspx
If you have SCOM in your environment you could setup the counters there as well. Additionally Idera has a performance monitoring tool that captures some basic metrics
http://www.idera.com/Products/Free-Tools/SharePoint-perf-monitor/ Their full product offers a lot more of course.
Once you have identified the offender you can decide how to proceed to alleviate the issue (add memory, move application, new server, etc). However if are resource poor, you may need to adjust some settings for the amount of memory the App Pool's can use, in addition the native SP throttling.
Edit
Links to review regarding AppPools:
http://technet.microsoft.com/en-us/library/dd364136(WS.10).aspx
http://technet.microsoft.com/en-us/library/cc263121.aspx#section3
http://technet.microsoft.com/en-us/library/cc732519(WS.10).aspx
http://technet.microsoft.com/en-us/library/cc262787.aspx
http://angler.wordpress.com/2011/06/20/detecting-memory-leaks-in-sharepoint-2010/
http://www.benjaminathawes.com/blog/Lists/Posts/Post.aspx?ID=18
http://mossblogger.blogspot.com/2010/07/wfe-application-pool-limitations-in.html