HNHacker News
TopNewBestAskShowJobs

clashmeifyoucan

530 karma · joined June 24, 2019

aadibajpai dot com
submissionscomments
clashmeifyoucan··on Building a Dark Web Crawler in Go
In fact it is a bit more severe than that as you are effectively deanonymizing yourself. If everyone else is using a 3-hop circuit but your crawler is using just 2 hops, it wouldn't take much effort to isolate your activity in the network since you're effectively standing out.
clashmeifyoucan··on Building a Dark Web Crawler in Go
That is correct. Tor Project has really struggled with negative connotations in the media with the so called "dark web" so I believe the terminology does play a part.
clashmeifyoucan··on Building a Dark Web Crawler in Go
Actually, the official term is Onion Services (https://2019.www.torproject.org/docs/onion-services.html.en check out the first paragraph)
clashmeifyoucan··on A guide to Web scraping without getting blocked
While I don't think scrapers have legal action taken against them unless they become a major pain for the company, faking User-Agent strings has been painted as spoofing by lawyers, https://stackoverflow.com/a/20926119/9044659 (very old example).

I wonder if employing these methods worsen the legality (or the lack of it thereof) associated with scraping.

clashmeifyoucan··on Web Scraping and Crawling Are Perfectly Legal, Right? (2017)
Now, what I'm not sure about and don't have the means to consult a lawyer about is

1) How liable is the author of a scraper who put it on GitHub but never did use it themselves. Because I remember seeing a lot of implementations and tutorials of tools like BeautifulSoup that don't necessarily comply with the ToS.

2) What if you edit the User-Agent to something that resembles a browser provided the scraper is just substituting browser interaction, e.g. those search from your terminal applications. Could/would it be construed as impersonation or something?

clashmeifyoucan··on Google CTF 2019
/lib/ld-musl-x86_64.so.1 /bin/busybox chmod +r ORME.flag /lib/ld-musl-x86_64.so.1 /bin/busybox cat ORME.flag
clashmeifyoucan··on Google CTF 2019
I bypassed the shell by executing the binary straight from the loader so I was able to do a chmod +r and cat to get it.
← PreviousPage 4 of 4