Back in 2018 i crawled 200Million urls of single site by using just freely avilable proxies on the internet to evade rate limits. i do not think it can be repeated today.
CDNs are blocking even my genuine requests.
CDNs are blocking even my genuine requests.