Forum Moderators: phranque

Message Too Old, No Replies

How big is. *the internet*?

Estimated amount of WWW pages?

         

tharapita

9:17 am on Aug 17, 2007 (gmt 0)

10+ Year Member



Well, the headline is more ambitious than the content.

I'm actually asking about the size of the world wide web. What is the estimated size of quality content (that is excluding dynamic page loops etc).

Search engines used to have a few billion to 5 billion pages indexed. Some research docs I was referred to from Wikipedia estimated the size closer to 30 billion.

Questions:
1. Does anybody know how many pages search engines have indexed these days?
2. What is the amount of quality webpages (worth indexing) considered at these days?
3. What is the average page size of a HTML page?

Gibble

3:35 pm on Aug 17, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Well, if I search for the word/letter "a" on google I get over 9 billion pages, though, the word though is just shy of 6 billion.

But then...this isn't really accurate :)

pageoneresults

3:38 pm on Aug 17, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Welcome to WebmasterWorld tharapita!

What a great question and one I've not seen asked in a while.

I wonder too, just how big "Our Universe" is. ;)

viperctw

7:55 pm on Aug 17, 2007 (gmt 0)

10+ Year Member



Most search results I've ever seen on Google were 10.5 billion for "1" (it seems to have dropped now)

The Wayback Machine says they've cataloged 85 billion pages since 1996. Obviously most of those are no longer up and running, but an interesting number :)

Lord Majestic

8:01 pm on Aug 17, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



1. ~30 bln (G/Y).
2. Hard to say as "quality" can be defined differently, however there are at least 200 bln unique urls out there.
3. 25KB.

pageoneresults

8:01 pm on Aug 17, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Welcome to WebmasterWorld viperctw!

Okay, that's 2 for 2. Anyone else lurking out there? ;)

bcolflesh

8:13 pm on Aug 17, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



How big is. *the internet*?

I was surfing and got to the end of it the other day:

[google.com...]

Gibble

8:15 pm on Aug 17, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Wow, you beat the internet...and you did it in one life. You used cheat codes didn't you!?!

/bow

[edited by: Gibble at 8:15 pm (utc) on Aug. 17, 2007]

bcolflesh

8:28 pm on Aug 17, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



You used cheat codes didn't you!?!

I had one of those "Dummies" books.

Essex_boy

9:19 am on Aug 18, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



well it cant be that big, it all fits on my PC......

Habtom

10:43 am on Aug 18, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



bcolflesh, the first result on your search was quite amusing.

Congratulations! This is the last page.
Thank you for visiting the End of the Internet. There are no more links.

You must now turn off your computer and go do something productive.
Go read a book, for pete's sake.

Spanger

2:56 pm on Aug 18, 2007 (gmt 0)

10+ Year Member



Hehe, HERE's the actual end:

<snip>

=D

Oh, and Essex_boy? Are you SURE?

<snip>

Spanger

[edited by: trillianjedi at 4:15 pm (utc) on Aug. 18, 2007]
[edit reason] Let's keep to the authorities please ;) [/edit]

vincevincevince

3:21 pm on Aug 18, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Not sure about page count, but the total size must be under 700Mb. That is, unless AOL misses some of the boring stuff out from the CD versions.

tharapita

7:08 am on Aug 21, 2007 (gmt 0)

10+ Year Member



Thanks for the excellent answers so far.

Habtom

7:24 am on Aug 21, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It is proved, it takes about 4,381 years to download the internet.

Infact W3Schools have been downloading it [w3schools.com]for the last 2 or 3 years now.

Habtom

<add> vincevincevince, oops I should have mentioned that I had no idea where that figure came from, or it is even close to the truth. Just wanted to show you this (W3Schools download in progress) [w3schools.com] </add>

[edited by: Habtom at 7:49 am (utc) on Aug. 21, 2007]

vincevincevince

7:43 am on Aug 21, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It is proved, it takes about 4,381 years to download the internet.

Is that based upon your link speed (what speed?) or upon the maximum possible throughput of all servers in the world if you had a pipe of infinite size? How are CGI pages dealt with in that calculation?

File: next.php

<?php
sleep(10);
print "<a href=\"next.php?page=\"".($_GET[page]+1)."\">Next</a>";
?>