>I guess we should just train an RNN to output a caption so that it can tell us what it thinks is there. Then maybe the philosophers and cognitive scientists will stop telling us what our nets cannot do.

I wonder if he knew about the Stanford paper that demonstrates this? Or if he just guessed this would happen.

http://cs.stanford.edu/people/karpathy/deepimagesent/