Have a look at nagios. It's a popular open source server/application monitoring tool. You can define custom alerts and monitor basicly everything.