Is there a forum or somewhere web crawlers hang out online? I'd love the learn about more sophisticated projects like this.
Although I'd absolutely welcome some sort of channel!
https://github.com/topics/crawling https://github.com/topics/web-scraping https://github.com/topics/web-archiving