[Air-l] Re: Air-l digest, Vol 1 #94 - 4 msgs

monaco greg at greatplains.net
Tue Aug 28 11:37:44 PDT 2001


number of web pages worldwide

Regarding number of web pages world wide, I was informed that C. Lee Giles
at Pen State (www.ist.psy.edu/faculty/giles.html) has developed some tools
to sample and estimate the number of pages.  I also learned of the
distinction between the dark web (pages inaccessible to crawlers) and the
pages that available and referenced via search engines.  It seems that one
estimate has the dark web at 90% of total pages.

Greg Monaco

Gregory E. Monaco, Ph.D.
Program Director, Advanced Networking
National Science Foundation
703-292-8948





More information about the Air-L mailing list