In both .webm and .mp4, the index is/can be at the beginning of the file, so you don't have to wait until video loads.

Also, since HTTP 1.1 we have byte ranges, so in combination of above point, you can freely seek with HTTP-streamed videos.