ParentFull threadJamesGreene·With the way web hosting servers are set up, and specific companies that sell this hosting, bandwidth for crawling/scraping is basically $0 at most popular companies.View on HN