I see 'Results 1 - 10 of about 2,200,000 from mahalo.com'
Have things stepped up a gear or am I misunderstanding?
I see 'Results 1 - 10 of about 2,200,000 from mahalo.com'
Have things stepped up a gear or am I misunderstanding?
According to what Jason said in another comment, however, all of their pages are listed in their xml sitemap, and all of those are listed in a master xml sitemap index located here (warning! huge files if you follow the links in the first one!):
http://www.mahalo.com/sitemapindex.xml
Based on what I saw 2 million+ looks like a huge overestimate, if what Jason said is true.
Edit: My bad, frederickcook's answer was the right one. I didn't realize you were doing a regular text search.
Methodology:
wget http://www.mahalo.com/sitemapindex.xml
cat sitemapindex.xml |sed -e's/[<>]/\n/g'|grep ^http|xargs wget
for P in sitemap-mahalo.xml* ; do echo $P ; cat $P |sed -e's/[<>]/\n/g'|grep ^http|wc -l ; done
Edit: FormattingSimply "mahalo.com" lists every indexed page with that text on it, such as this one.
It also says 59,300,000 for scribd.com which I can't help but draw comparisons with this.