Probably a large part of that is because they are much more permissive to bots/crawling than Google searches.