I think Skype already might be doing something like this. The audio passes through ok when the screen feed freezes due to network congestion