1) Have a monitoring in place. 2) Never miss alerts, use smth with multi-channel escalation like amixr.io