One of the primary factors that enabled Google to stay great was their ability to crawl and index the ever growing web at a rate no other company could.