Deep image captioning is essentially what you are describing.

Check out:

http://cs.stanford.edu/people/karpathy/deepimagesent/

http://cs.stanford.edu/people/karpathy/densecap/