There's been a ton of interesting research and progress on this in the last few years: https://ai.googleblog.com/2018/04/looking-to-listen-audio-vi...