would be interesting if you could used deepfloyd first for image composition, then apply stable diffusion after for purely stylistic modifications
Explaining: I created a model of me, and wanted to create some good realistic portrait pictures. First I tried to create a model of me using some of the custom models already exist and the result was bad.
Then I tried SD 1.5/2.1... It was better, but couldn't really get some of the prompts make real...
Then I tried new Dall-e, saved, and inserted my face with img2img on SD and it worked much better!