I remember doing something like this without the neural networks that is, but my results were very very bad. If i find that project in old laptop i'll post it to github.