Interesting idea. There is a blog post with more information at http://alexisvallet.github.io/posts/anime-character-detectio...
Also, it incorrectly identified two characters on the demo for me: http://a.pomf.se/pykdwz.png
Source: https://github.com/alexisVallet/anime-character-detection it seems