Train yourself not to do it. It's not that hard, and it will go a long way in improving your communication.

Record 30 seconds without ums. If you failed, do it again. Then increase the time. Stop if you fail to much/can't concentrate, try again tomorrow. Recording yourself is the perfect opportunity to train.