Something like https://github.com/nci/drishti might be useful.