Scrapy is a django-like framework. It has more structure and a lot of built-in features compared to using a library like lxml.
lxml and Scrapy use the same library on the backend, libxml2.
http://doc.scrapy.org/faq.html#how-does-scrapy-compare-to-be... http://doc.scrapy.org/topics/selectors.html