I think it's actually not that bad. Scrapping is a topic that is as broad as the number of sites on the web, a minefield of corner cases.