---
Oh, I see he's using the kaggle data. That's not guaranteed to be reliable.
---
Oh, I see he's using the kaggle data. That's not guaranteed to be reliable.
I wrote a scraper which pulled address info / phone number / star rating / review count for pretty much every restaurant in the US.
It was "easy" because all of that data is available within the search page, and you just need to correctly parse it out.
The hardest part was getting around their really crazy rate limiting and IP blocking.
I managed to get myself IP banned from yelp prior to ever trying to scrape by just doing a bunch of searches manually pretty quickly over like 20 min, next thing I knew I could no longer access anything on Yelp.
1 https://web.archive.org/save/[url] and most recent crawl: http://web.archive.org/web/20180109124942/https://yelp.com/
2 By incremental searches that each return under 1000 results.