[Air-l] Re: Air-l digest, Vol 1 #94 - 4 msgs
monaco
greg at greatplains.net
Tue Aug 28 11:37:44 PDT 2001
number of web pages worldwide
Regarding number of web pages world wide, I was informed that C. Lee Giles
at Pen State (www.ist.psy.edu/faculty/giles.html) has developed some tools
to sample and estimate the number of pages. I also learned of the
distinction between the dark web (pages inaccessible to crawlers) and the
pages that available and referenced via search engines. It seems that one
estimate has the dark web at 90% of total pages.
Greg Monaco
Gregory E. Monaco, Ph.D.
Program Director, Advanced Networking
National Science Foundation
703-292-8948
More information about the Air-L
mailing list