I would like to see that in scrapy. I think you may have a point about the generators, yea.