HNHacker News
TopNewBestAskShowJobs

yegg

3,855 karma · joined April 1, 2012

Gabriel Weinberg

https://gabrielweinberg.com/ (newsletter) https://ye.gg/ (personal homepage)

- Founder, DuckDuckGo (https://duckduckgo.com/)

- Co-author, Traction (2015, https://a.co/d/453gPyM)

- Co-author, Super Thinking (2019, https://a.co/d/6R73EsW)

- Author, The Great Race (2025, https://thegreatrace.us/)

* Personal email: yegg@duck.com

* Work email: yegg@duckudckgo.com

* Bluesky: @yegg13.bsky.social

* LinkedIn: https://www.linkedin.com/in/yegg13/

I also have an older account where I generated a random username. That's @epi0Bauqu

submissionscomments
yegg··on Techdirt has been deleted from Bing and DuckDuckGo [fixed]
Yes, that's right -- we do!
yegg··on Techdirt has been deleted from Bing and DuckDuckGo [fixed]
From lots of experience, I can tell you if you don't have these things (and others, this is an incomplete list just off the top of my head) showing up in the right places (often above "traditional web links") at the right times then you cannot get long-term search engine adoption from mainstream users:

- maps

- directions

- local business listings

- about boxes

- basic facts

- conversions

- news

- videos

- images

- shopping

- sports

- stocks

- weather

- flights

- entertainment (e.g. cast)

- etc.

yegg··on Techdirt has been deleted from Bing and DuckDuckGo [fixed]
It is simply not true that we have intentionally censored anything for political reasons or made ourselves "the arbiters of truth" in general, which people have also accused us/me of doing.

I realized I previously explained how our news rankings work very poorly on Twitter that got grossly misinterpreted, so I subsequently put out a clarification in this help page with a much clearer (and detailed) explanation of how our news rankings actually work: https://duckduckgo.com/duckduckgo-help-pages/results/news-ra...

From that page: "When we apply our own ranking signals we do so in a strictly non-political manner, meaning we don’t evaluate or otherwise take into account any potential political bias or leanings of websites in our search result rankings." That is, we did not/do not have a disinformation/"truth" detector, nor did we go looking for any Russian narrative (or any other narrative for that matter). Instead, we just have essentially a spam detector that had detected some spam from Russian state sites. That's it.

yegg··on Techdirt has been deleted from Bing and DuckDuckGo [fixed]
I don't believe I have ever made that claim and it isn't true either that we are "little more than a Bing mirror". See other comment on this thread (https://news.ycombinator.com/item?id=36898807) but in short it isn't a binary thing and I think the fallacy people keep making is a modern search engine != web index.

Over the past fifteen years, search has become "universal" with dozens of indexes and modules throughout the page. Also it is important to understand people click/engage with things on the page roughly half as much each position down, so by the time you get to the bottom it is like 100 times less than the top. This means that things on top, increasingly non-web links, have become more and more important.

In this context, as mentioned in the other comment, the largest modules on mobile and desktop we power ourselves, that is, local and knowledge graph. AI will be the same. We do use Bing as the primary source for traditional web links, but not for all and even when we do it sometimes looks different in various ways. In something like this, we can re-insert this link if that is what is needed.

yegg··on Techdirt has been deleted from Bing and DuckDuckGo [fixed]
None of that is contradictory. To paraphrase:

- We have on the order of a million lines of search code at this point and have a lot of talented people working them. That code does a myriad of things across many indexes.

- As an example, mobile searches are the largest category of searches, and local searches are the largest category of searches within mobile. We don't get any local search module content from Bing.

- Similarly, on desktop, knowledge graph / Wikipedia-type answers come up the most and we don't get any of that module content from Bing either.

- Bing is our largest source of traditional web links, which have become less and less relevant/engaged with over time as more and more modules are in search results and put on top of traditional links (and people interact with things on top of the search results page about two orders of magnitude vs. things on the bottom).

- When Bing has dropped things out of the traditional web index, we have put them back, and we've been working with them so this happens less and less. In fact, there hasn't been hardly any reports of this in the past month or so, which is why I've asked for other examples in the comments.

yegg··on Techdirt has been deleted from Bing and DuckDuckGo [fixed]
Any particular examples you can remember that I can look into personally (and bring back to the team to look at as well)?
yegg··on Techdirt has been deleted from Bing and DuckDuckGo [fixed]
Do you know what they are? Happy to investigate along with TechDirt and that might help.
yegg··on Techdirt has been deleted from Bing and DuckDuckGo [fixed]
(DuckDuckGo CEO/Founder) Just seeing this and we're looking into this now. This is not intentional.

Update: Still investigating, but have made some progress -- Determined that on desktop there was a link to Techdirt up continuously via our About module (when you search for "Techdirt"). And now the traditional web link is back up as well (for desktop and mobile): https://duckduckgo.com/?q=techdirt&ia=web.

yegg··on Tell HN: Interview take home assessments without feedback are frustrating
We do pay people at every stage regardless of outcome and so not sure what happened. If you email me I’ll figure it out though.
yegg··on Tell HN: YouTube download websites disappearing from Google search results
> Let's say the real purpose was always to reduce "news spam", and Russia increased their news spam when invading Ukraine.

Yes, that is correct. See https://news.ycombinator.com/item?id=36145183

There is a difference between my personal political opinion and the fact that DuckDuckGo itself acts non-politically, which is what actually happened.

yegg··on Tell HN: YouTube download websites disappearing from Google search results
Yes, it was.
yegg··on Tell HN: YouTube download websites disappearing from Google search results
We actually always had a bunch of our own stuff, and still do, as well as work with other partners. For example, the number one module on mobile is local, and we don't get any local stuff from Bing at all. Similarly, the number one module desktop is knowledge graph, and we don't get that from Bing at all either. And yes, you can re-insert results if they are indeed censored, but Bing doesn't really intentionally censor anything either as far as we can tell or we'd here a lot more about it. Occasionally something drops out of the index for some kind of bug reason that gets fixed.
yegg··on Tell HN: YouTube download websites disappearing from Google search results
That doesn't seem fair at all. Our privacy protections have only gotten stronger as we've protected you more and more beyond search.
yegg··on Tell HN: YouTube download websites disappearing from Google search results
On this last point, a search engine has to provide local results to be useful, e.g., local weather, restaurants, etc. We do that always in anonymous fashion, as explained here: https://help.duckduckgo.com/duckduckgo-help-pages/privacy/an...
yegg··on Tell HN: YouTube download websites disappearing from Google search results
That page is being transparent about how exactly it works, which is why I wrote it. I'm sorry you don't like the words I chose, but they were not chosen to "weasel" out of anything, but to be accurate, which is why I keep quoting them. We can consider more transparency for sure, and duly noted.
yegg··on Tell HN: YouTube download websites disappearing from Google search results
It is about spam. There are actually many flavors of spam and they each need their own spam detector. For example parked domain spam vs. adult content spam vs. copycat site spam vs. content-farm spam vs. news spam.

This is about news spam. The referenced organizations are evaluating a supposed news site's process on how they go about making news ("journalistic standards") and in particular what we care about is whether there really is any process/standard at all. That is, we're only looking for the very few sites that everyone agrees has no news process and is just a site purporting to be a news site but isn't in reality. From the page: "a well-documented history of a site’s extremely low journalistic standards, correlated with: routinely using spam or clickbait to artificially inflate traffic, consistently publishing stories without citing sources, censoring stories due to operating with very limited press freedom, and misleading readers about who owns, funds, and authors stories for the site." Spamming search engines to game rankings is the primary criteria here.

However, we note that "Many sites may occasionally do one or more of these things, but we take action very rarely, only in the most extreme cases." We're talking tiny amounts of domains here because "we must see at least three of these organizations independently assess a site as having extremely low journalistic standards and also see that none of these organizations have assessed the same site as having even somewhat robust journalistic standards." That means if the site has any pulse of a real news site then it doesn't get counted as spam.

And it also says for these spam sites: "We trust that users can find the right information for themselves, so even in these rare cases we do not remove these sites from our search results page. Additionally, impacted sites are not moved so far down in the results that they are effectively removed."

yegg··on Tell HN: YouTube download websites disappearing from Google search results
First off, we do not remove any results ourselves for political purposes and in fact we have been banned in China for many years for that very reason. What you're referring to was a temporary bug in our image search results from Bing that they promptly fixed. If they hadn't fixed it promptly then we would have taken further action. That seems hardly cause to abandon us.

That said, super slow results I can understand :). But they are super fast according to all our metrics, so something else must be going on. There was a bug in DarkReader recently causing our page to be slow that was recently fixed -- not sure if that is related. In any case, if you want to email me (my email is my profile) then we can try to get to the bottom of it.

yegg··on Tell HN: YouTube download websites disappearing from Google search results
I never said they are synonyms. What I am saying is we are acting on spam and not misinformation. We do not have a misinformation/disinformation/truth/lie detector or whatever you want to call it. We do not evaluate individual stories or narratives for truth and never have. We are not an "arbiter of truth" in any way. We did not go looking for anything Russian or for any other country in particular. We did not go looking for any narrative at all. And highest level as I quoted from the News Rankings page, "we don’t evaluate or otherwise take into account any potential political bias or leanings of websites in our search result rankings."
yegg··on Tell HN: YouTube download websites disappearing from Google search results
See https://news.ycombinator.com/item?id=36143328.

To be clear, we do not censor. Per the help article referenced above (https://help.duckduckgo.com/duckduckgo-help-pages/results/ne...): "we don’t evaluate or otherwise take into account any potential political bias or leanings of websites in our search result rankings."

yegg··on Tell HN: YouTube download websites disappearing from Google search results
See https://news.ycombinator.com/item?id=36143328.

I had poor word choice that got grossly misinterpreted, so I subsequently wrote the help article referenced above (https://help.duckduckgo.com/duckduckgo-help-pages/results/ne...) to give clarity: "we don’t evaluate or otherwise take into account any potential political bias or leanings of websites in our search result rankings."

In reality we never censored anything, nor do we have a disinformation/"truth" detector, nor did we go looking for any Russian narrative (or any other narrative for that matter). Instead, we just have essentially a spam detector that had detected some spam from Russian state sites. That's it.

yegg··on Tell HN: YouTube download websites disappearing from Google search results
(Hi, I'm the CEO & Founder of DuckDuckGo.)

It is simply not true that we have censored anything or made ourselves "the arbiters of truth." I realized I previously explained how our news rankings work very poorly on Twitter but I subsequently put out a clarification in this help page with a much clearer (and detailed) explanation of how our news rankings actually work: https://help.duckduckgo.com/duckduckgo-help-pages/results/ne...

From that page: "When we apply our own ranking signals we do so in a strictly non-political manner, meaning we don’t evaluate or otherwise take into account any potential political bias or leanings of websites in our search result rankings."

yegg··on Brave releases its Search API, bringing independence to the search landscape
We didn't nuke them, see https://news.ycombinator.com/item?id=35691426 (from that thread).
yegg··on Advertise on DuckDuckGo Search
Yes, I'll look into it.
yegg··on Advertise on DuckDuckGo Search
Sorry to hear that. Our process is to follow-up with everyone, so I'm not sure what happened. If you want to DM me on Twitter I can look into it.
yegg··on Advertise on DuckDuckGo Search
Sorry, looks like this new feature is being re-tooled today, but should be up again within a few days!
yegg··on Advertise on DuckDuckGo Search
Have you been using the new button we put there to do that? (I realize you still have to press the button, but curious if you are liking it.)
yegg··on Advertise on DuckDuckGo Search
Yes, he is the best person to discuss such requests.
yegg··on Advertise on DuckDuckGo Search
x-posting from https://news.ycombinator.com/item?id=35980374

(I'm the CEO & Founder of DuckDuckGo.)

It is simply not true that we have censored anything or made ourselves "the arbiters of truth." I realized I previously explained how our news rankings work very poorly on Twitter but I subsequently put out a clarification in this help page with a much clearer (and detailed) explanation of how our news rankings actually work: https://help.duckduckgo.com/duckduckgo-help-pages/results/ne...

From that page: "When we apply our own ranking signals we do so in a strictly non-political manner, meaning we don’t evaluate or otherwise take into account any potential political bias or leanings of websites in our search result rankings."

yegg··on Advertise on DuckDuckGo Search
Note that we added support to remove those Google login pop-ups on third-party sites within our apps/extensions. See https://help.duckduckgo.com/duckduckgo-help-pages/privacy/we... for details and https://help.duckduckgo.com/duckduckgo-help-pages/privacy/we... for the full list of other protections.
yegg··on Advertise on DuckDuckGo Search
No, we're not. See my comment at https://news.ycombinator.com/item?id=35980451

But more to answer the OP, we've been making a lot of investments to improve our results (along with other things) -- high-level updates posted quarterly at https://duckduckgo.com/updates

← PreviousPage 4 of 14Next →