You mean as a prompt generator? There are already finetunes for this, though most people use smaller models.
If you are talking about transformers llms that output pixels, that is an area of active research... I hope you have a few million dollars lying around, though.