One of the original incarnations of Google Video was something somewhat similar to this (an index of closed-captioning data from a lot of different tv streams). What they chose to do with it was different though: they allowed you to search closed-captioned content and it would show you a few thumbnails and the time of day when those words were said on air.
This memory is kind of hazy, ISTR it's from 2005 or so.