Unless this is a whitelist, it's a metric which will be gamed.
If it is a white list, then why have a search engine rather than an old school curated Yahoo directory?
If it is a white list, then why have a search engine rather than an old school curated Yahoo directory?
They can do everything except the one thing that would actually hurt the search engine spammers right in the coin purse: Penalize websites for having ads.
- Sergey Brin and Lawrence Page, The Anatomy of a Large-Scale Hypertextual Web Search Engine
Oh ... this is such a good idea. I'm like tempted to try it and see what happens.
Then it was we can measure that and make money.
Now it’s just we can make money.
Whether that part is sinister or not, we know that we have a good number of bad actors, and from search engine results we can be sure that they have not developed a workable Byzantine fault tolerance mechanism to filter out the bad actors. Those who scream the loudest get put on a stage.
Whitelists that I wrote by hand also don't introduce new unexpected entries by the way :)
This instead could be more like RSS where as your crawler gets new sites, you get updates on new things, and you could filter in your crawler or in RSS client directly, doesn't matter.