Hacker News Reader

Comment by mancerayder | Hacker News Reader

I thought HN auto-redirects you to the main post if you try to post a duplicate? I wonder why the dups keep happening. It's not detecting them?

View on HN

Two different URLs:

http://www.bbc.co.uk/news/technology-37880723

http://www.bbc.com/news/technology-37880723

Maybe the mods could also de-dupe some of these hostnames (like m.nytimes.com and nytimes.com).

Though now thanks to AMP, it might make more sense to de-dupe on known prefixes rather than Host particularly. Sadly, for the BBC at least that won't work, since the URLs look like they do /amp instead of their usual sections:

https://www.google.com/amp/www.bbc.co.uk/news/amp/36788782?c...

Maybe they can follow through and see how the URL resolves and compare the resulting URL as opposed to the posted URL. As it is, multiple URL shorteners can all direct to the same URL and all have different posts.

I think HN used to have stronger dupe detection, but they realised that many good stories were not getting the discussion they deserved.

So now the dupe filter is weaker.

((Obviously I'm not a mod, but I'll try to find a post from dang or sctb explaining this))

EDIT: Here's one: https://news.ycombinator.com/item?id=10223645

> We've adjusted the dupe detector to reject fewer URLs. If a story hasn't had significant attention in about the last year, reposts are ok. That's been the policy for a while, but we've brought the software closer to it. It will still reject reposts for a few hours, though, to avoid stampedes. Allowing reposts is a way of giving high-quality stories multiple chances at making the front page. Please do this tastefully and don't overdo it.

I think the dupe detector only ever identified identical URLs. (And you might notice some sites add some random junk at the end of the url to evade dupe filters on various sites).

It auto redirects if the URL is identical. I think they will call it a dupe if it is the same content, different URL, or essentially the same story, even if it is a different write up.

/Not an HN mod and I do not play one on TV

Even with the same URL this doesn't work every time.

Reply on news.ycombinator.com