For this problem specifically, I have found that turning off auto mic volume helps to eliminate the "mute for first x secs if speaking".