Note this has been a problem as long as Wikipedia existed though.
Doesn’t work on iOS, even though the official ogv.js demo works.
Adding on to this: iOS doesn't play mp3 for mp4 containers either. Encoding media to play on an iDevice means resorting to AAC, which doesn't have as good licensed codecs.