You should check out the Op3nVoice API: http://www.op3nvoice.com/

Lets you search video/audio for spoken words.