You can google "source separation" to get background on this, Stanford has what is supposed to be a nice lib.
https://www.reddit.com/r/MachineLearning/comments/4oewdq/rnn...
https://www.reddit.com/r/MachineLearning/comments/4r92iq/wou...
https://www.reddit.com/r/MachineLearning/comments/66j2i4/p_i...