Seems ill-advised given Meta's and maybe Bytedance's apparent unwillingness to do any throttling or rate limiting at all, not to mention the residential proxies that behave very poorly.
Fair point.
The problem is that the same defense sites uses also block one's personal AI agent from doing useful work on your behalf. Like checking your bank account, booking a flight, ordering stuff you need on amazon, etc. That's the gap i'm working on.
The problem is Meta's behavior, go fix them. Go fix the unethical residential proxy business. Providing a way for those near criminals to duck out of behaving well is something you can avoid by not doing whatever I'll advised thing you're hoping to do.
hold on.If you have strong conviction about where the problem is why don't you fix it? why ask me?
You're the one publicizing "reliable web access for AI agents and automation", I'm not. I'm pointing out that by doing what you claimed one post up, you're giving Meta and Bytedance and residential proxies license. They (and their sockpuppets and supporters) something to point at when people complain about Meta and Bytedance crawlers' ill behavior. "Just do what 'cyzanfar' does", they'll say, "it's a skill issue on your part".