Hacker News Reader

First, happy customer of OSM and it’s impressive what they’ve built! That said, I’ve noticed their company website field is sparsely populated.

Any recommendations for acquiring the place website URL through an API or ethically scraping it at scale? I’m specifically wondering about options that wouldn’t involve Google Places.

View on HN

Read up on what OSM is before you scrape!

And maybe Overpass will work for you: https://wiki.openstreetmap.org/wiki/Overpass_API

Do NOT scrape OpenStreetmap, you can download the full dataset for yourself: https://planet.osm.org/ and search for what you want in it.

If you want regional extracts, you can simply download them from Geofabrik at https://download.geofabrik.de/

Reply on news.ycombinator.com