Are you using an open-source web crawler like Stormcrawler / Apache Nutch or are you using Google queries as others suggested?
Here's the Rust library I built that powers the core of my project, if it's any help: https://github.com/milesmcc/ieql
Relatedly, because I feel like my tool relies so much on open-source software and public archives, I give 10% of my service's revenue to various open source projects. Tools like these are only possible at this price point if they're built on the shoulders of giants (i.e. tons of open source software and publicly available web archives).