Hacker News Reader

Comment by neonate | Hacker News Reader

That site is blocked in some countries.

     x=https://www.wsj.com/amp/articles/netflixs-reed-hastings-deems-remote-work-a-pure-negative-11599487219

    curl $x |sed -n '/<title/s/.*/<!doctype html>&/;/<span/d;/<div/d;/<\/div/d;/./{/<amp-ad/,/<\/amp-ad/d;};/^ *{{summary.headline}}$/d;/<title>/,/<\/title>/p;/<p>/,/<\/p>/p' > 1.htm

   firefox ./1.htm

Even easier (big, GUI browser might be overkill)

   links $x

What kind of a paywall does WSJ have? I always get a wall.

Is it X articles free per month, or do they allow only crawlers on their sites?

They used to allow crawlers and Twitter and some other links through, but they're almost entirely behind a paywall now.links through Facebook or Twitter may still work, but they definitely do not work through Google anymore.

I blocked them from my Google feed as well as numerous other ones. I'm not going to pay to see ads

I’ve seen other sites that do the same, it’s as if they just have a paywall permanently now and only say you can get a few free articles rather than mean it.

You can never seem to trick it even if you want to...

... it's almost like their server knows you're a person and not a crawler

Reply on news.ycombinator.com