[Air-l] Re: Air-l digest, Vol 1 #94 - 4 msgs

Ellis Godard ellisgodard at starband.net
Tue Aug 28 19:26:52 PDT 2001


And how does one count dynamically generated pages? Are there as many web
pages as books available through Amazon? Is google's index counted as only
two web pages even though almost every instance of the second one is
different?

-----Original Message-----
From: air-l-admin at aoir.org [mailto:air-l-admin at aoir.org]On Behalf Of
monaco
Sent: Tuesday, August 28, 2001 11:38 AM
To: air-l at aoir.org
Subject: [Air-l] Re: Air-l digest, Vol 1 #94 - 4 msgs



number of web pages worldwide

Regarding number of web pages world wide, I was informed that C. Lee Giles
at Pen State (www.ist.psy.edu/faculty/giles.html) has developed some tools
to sample and estimate the number of pages.  I also learned of the
distinction between the dark web (pages inaccessible to crawlers) and the
pages that available and referenced via search engines.  It seems that one
estimate has the dark web at 90% of total pages.

Greg Monaco

Gregory E. Monaco, Ph.D.
Program Director, Advanced Networking
National Science Foundation
703-292-8948


_______________________________________________
Air-l mailing list
Air-l at aoir.org
http://www.aoir.org/mailman/listinfo/air-l





More information about the Air-L mailing list