I wrote this earlier this year, covers quite a few details, it's been featured on HN frontpage a couple of times though so maybe you have already seen it.

http://jakeaustwick.me/python-web-scraping-resource/