Firefox supports MP4, and they changed their position two years ago when Google and Adobe weren't as all in as they claimed to be. Further through an appropriate media plugins that browser should support anything the platform supports, and it was pure dogma that had it refuse early on.
Apple is never going to support WebM. This kills the format. There are hundreds of millions of devices that can hardware decode MPEG4 than can't for WebM. Nay, billions of devices. Of course WebM is always just around the corner, but this has just led to a stagnation where the scourge of animated GIFs reigned supreme.