I agree with this in general, but there are exceptions. For example, it would be nice to know immediately if a new change has caused your conversion rate to drop precipitously for some reason, so that you can turn it back off and take a minute to see if you can figure out why before you lose a full day's worth of revenue.