There are several projects like this, but they can only generate abstract shapes, i.e. they're much lower-level than a natural language caption.
Context Free is incredibly fun but it's not machine learning or even AI. And it's very easy to understand how things go from defintions of shape, rotations, translations, etc, to the finished image.