Web crawling. (https://arxiv.org/pdf/2103.00020.pdf 2.2)
> Are there people out there spending thousands of hours just tagging or writing descriptions of training images?
"Yes", Google Image Search, Wikipedia captions, Danbooru are all that in some sense.
The biases should be obvious if you think about it for a minute and CLIP has even more biases since they removed all kinds of NSFW content, etc.
> And does DALL·E just receive the image as-is with its description, or does it get more info (e.g. "this part of the image is the dog")?
Only that, but segmentation is a big research area too and it looks like FB has a reproduction with some of that mixed in.