I said you can _crawl_ in the sense that it's technically possible & easy. Also I don't think you'd get into trouble if you use it for your own research and not disclose your results.