With Airflow you can have it send an email on task failure which you can then hookup to a bunch of things -- slack, pagerduty, etc.
We've also used rollbar for logging, so I've hacked the airflow script to setup a logger that reports warn and above to rollbar so we'll get alerts that way as well if something is deadlocked or whatever.