HNHacker News
TopNewBestAskShowJobs

itsokaywelldoit

1 karma · joined September 4, 2023

Part of small team trying to get in scraping If you want to contact us - scraper.developmentteam@gmail.com
submissionscomments
itsokaywelldoit··on Ask HN: What can we do with 20B links from sites
Sorry, missed the point of the question. Finding specifically links - because of that client. As we were working on his project we slowly began to realise that cross-referencing sites, links to competitors and stuff like that might be useful for someone. Also, with links u can go deeper into the site, and scrape links from all pages.

And maaybe we got too in love with the concept so now we're firmly stuck in it, finding reasons for our behaviour that are not "woohoo it's so fun to play with it and we have justification to spend time here - it's gonna work for us!"

itsokaywelldoit··on Ask HN: What can we do with 20B links from sites
We had a client that needed similar project, but for small amounts of domains, and we had the list of domains 'just lying around', so we thought 'wait, if our client knows where to use it then there's a market', and, well - wrote some more and combined the two.