So the overhead to begin a video stream is due to the size of video data? Would video behave generally more like audio data (could stream immidiately) if the typical user bandwidth was larger?
Audio doesn't have such a concept, you get 33ms worth of audio, you can play it right away.
Of course, you can opt to not have b-frames and negate that issue.