I'm not a Musk fan but if this play is in the cards, his actions could be rational.
767 karma · joined August 16, 2022
I'm not a Musk fan but if this play is in the cards, his actions could be rational.
The only requirement is a sound argument. The source is an unimportant detail.
Facts! It always feels intrusive. I have them blocked by default on mobile and desktop. However, I also have all notifications on my phone disabled as well as permanent do not disturb mode.
Property should not make demands for attention.
While I understand your point, I decline.
Silence favors the wicked.
I plan on conducting a field experiment to determine if it's a net-positive or net-negative activity. My hypothesis is that HTTP1 is largely a risk with no benefit when coupled a bypass for search engines. I feel uncomfortable making claims until I can prove its the better move.
I've monitored my HTTP1 traffic and its split between declared bots and malicious bots.
If your position is congruent with the parent comment, I know exactly what you are. I have no reason to debate small humans.
"Using circular logic to refute someone's point isn't too smart either."
Also, straw man. I chose "disregard" intentionally. Disregard is not synonymous with refute.
And if you do, they will keep your membership active (for years) before reporting debt to the credit agencies.
Solid point.
"Perhaps you could operate this in a log-only passive mode for a while to log what would have been blocked?"
I can and will. This seems to be the safest way forward.
"The same applies to malicious bots. They can be crawling hundreds of sites at the same time. There is no way to guarantee your site gets the same threads and resources by the bots. Some of them are using pools of LTE modems so even their IP's will be spread across a large CIDR block."
This is very true. Best case scenario: you block all malicious bots... but then they evolve. I'm viewing this from a resource efficiency perspective. I want to limit the cost of automated hits.
"That said, if you specify a crawl delay of 2 seconds in robots.txt and the bots do not obey this then perhaps it may be worth blocking them."
Which makes this a great idea. It's simple and dichotomous. All desirable bots will respect this declaration.
"Allowing HTTP/1.1 for the bots that specify the google user-agent will not accommodate their bots that pretend to be Android phones and may result in Google flagging your site as potentially malicious. Some malicious bot tools will also use their user-agent in attempt to bypass authentication on some sites."
Ah, I just realized Googlebot and these "android bots" use 1.1. Wouldn't be a problem otherwise. I'll leave this idea alone for now. Never anger the SERP gods. :D
Edit: It seems Googlebot does not accept the crawl-delay directive. Instead, it needs to be set in Search Console every 90 days.
I'm thinking that a parent request's time-on-page (or time between requests) would indicate whether to serve a 403 or content during a subsequent hit. There are a few false positive scenarios to deal with they seem manageable.
Any thoughts on that particular approach?
The bulk of bots seem to be running empty user agents which makes for a simple fix. I understand and agree that advanced bots (good or bad) will likely being impossible to detect. That's ok. I view it as "upping the ante".
"Another method I have used to squash a handful of bots is to require HTTP/2.0."
I'm at the quick, dirty, and effective stage so this is a solid recommendation. Thank you!
I'm 100% ok with that.
"I solve this with client-side techniques"
As a user, do you mind navigating these same approaches in the wild? Many time, I prefer leaving to solving a captcha.
Edit: The required FaaS implementation is trivial too. I could launch an endpoint that performs exactly this function in 30-60 minutes.
"So it's not that computers can or cannot make original thought, it's that we have to decide what parts of the outputs are original: it's an observer-dependent variable, so to speak? What do you think?"
This is a complicated statement. Novelty is certainly observer dependent. I suppose there should be two classes of novelty that consider context and perspective. Something can be new to the user (novel) and new as a solution (Novel). Though, there are also permutations to consider. For example, every year new users get online, but the Internet isn't a new solution.
I think we'd have to define what merits the designation of "novel thought" and the context before discussing the possibility.
It's an intriguing thought to consider regardless.
I concede. This is the better description.
I'm not going to lie... this made me laugh.
Your entire argument revolves around why content ought to be free to copy. What ought to be has no relevance to what is.
Find me 1 country that agrees with you. I'll show you 100+ that doesn't.
I hear you and actually agree that most coding will eventually be performed by AI. However, I'd bet against AI/ML ever being capable of original thought. One must first move past convention; something that is diametrically opposed to the current AI/ML approach. Time won't change this. A new paradigm might.
Either way, the most powerful commodity (and scarcest resource) is and has always been... original thought.
*thieves
It's a straw man.
The need for transparency in process is known, documented, and undisputed. Your comment has no relevance. My brain might be a black box, but I can still communicate and/or document the specifics of a process.
Can [insert your preferred model] do that? Didn't think so.