First of all congratulations on a) the science (built on the shoulder of giants...) b) the accessibility / interface and service

Wondering if you plan to open up a caption API of any sort? Can definitely use something like this. If you desire the training feedback, then that could be added as well as part of the API. I'd be willing to do that for some images. So if you do add a training feedback API, please make it optional.

Have you considered an 'abstract' type of version? As in, rather than simply describing the image as the caption, take the information that would be used, fill it in a MAD-LIBS[1] style setup, and see how that turns out? Maybe it's just me but a surrealist CaptionBot could be pretty fun.

[1] https://en.wikipedia.org/wiki/Mad_Libs

Thank you very much for putting your work out there for people to have fun with (and criticise!).

CaptionBot seems to have a bit of trouble with simple two-colour outline drawings. In one case I saw it even get the colour wrong ("red and white" for a black and red image).

Is that something you would have expected?

Also- I notice it doesn't do very well with character recognition either. Is that surprising?

It would be great if you added a text box under the stars so I can (optionally) tell you why I didn't give you five stars.

For example, I uploaded a picture of my daughter as an infant, and it said, "This is a baby on a bed and he's :D" which I gave four stars to because it said he instead of she. But honestly you really have no way of knowing that. :)

Do you know why it puts a lot of things on surfboards?

It seems from the comments that that is one of the most represented misclassifications.