the whole intarwebs

[anivair.livejournal.com]

The employees here are always joking that I must be downloading hte whole internet, since I regularly take up huge ammounts of bandwidth getting OS's and patched, programs and the like. I'm sure some of you out there get the same thing.

So I wonder how long it would take to download the whole internet. Assume a T1 connection (because to do otherwise would be painful). Anyone have an estimate? I'll bet there's data on this somewhere. And I'd like to be able to throw a figure back at them. For example, "Yes. I'm downloading the WHOLE INTERNET. I should be done by May r3d of next year."

Comments

[samwize.livejournal.com]

I rather suspect that the content of the internet grows significantly faster than the download speeds of a T1. Or OC3. So I doubt it's possible.

[anivair.livejournal.com]

For saftey's sake we can assume that you are downloading the current size, no the future size. the trick is figuring out how much data is out there and it's really hard. So far, no luck.

[inahandbasket]

assume a T1? I think you'd need to assume multiple OC3's to even CONSIDER downloading the whole internet in your lifetime... but now I'm curious.

[bdinger.livejournal.com]

^^^^^

I think with an OC-192, you could PROBABLY get all the porn sites in a year. PROBABLY.

[kallell.livejournal.com]

I worked for SBC and when we where trained on those, i see an OC196 and think " I want a 4 Gig per second connection to my home :("

[valiskeogh.livejournal.com]

first, you'd need something better than a paltry t1, THAT would be painful. a t1 is ~1.5 megabits/s , when i was at my call center job i was sitting on top of 4 ds3 lines, roughly 150 megabits/s, you'd want to be on that or higher.

plus the storage... you'd need... multiple petabytes of storage available... if not more...

i'd just make up a number...

[anivair.livejournal.com]

See? Now that was funny.

[omg-teh-funnay.livejournal.com]

I just wanted to let you know that I'm stealing that icon.

[zercool.livejournal.com]

from Berkeley (http://www2.sims.berkeley.edu/research/projects/how-much-info-2003/internet.htm):

Total size (2002): 532,897TB

Sooooo ... using a maxed-out T1 with no errors ... Umm ...

A damn long time.

If I did my math right, a T1 should handle about 15.5GB/day... so ... 94,000 years and change. Seriously.

[zercool.livejournal.com]

And using an OC192 (9.6Gb/sec), you're still looking at 15.3 years.

Hey, email me when you're done, k? :)

[anivair.livejournal.com]

sweet. That was EXACTLY what I was looking for.

[torkell]

This causes a problem: the exponential rate of growth means that whatever connection you have, it won't be enough. Unless, of course, you happen to have a OC-12884901888 or similar (good for 629145.6 Tb/s).

[anivair.livejournal.com]

True, but still I say it's worth knowing how long it would take currently (which, if the above is correct, is somehting approaching two hundred thousand years).

[jecook]

Actually, with OC192, one is hitting the limit as to how fast you can push the optical to electrical transceivers (both the TX and the RX components).

OC192 has been around for a while, actually. Unfortunately, the prices for that interface is still tremendous.

IIRC, a Juniper OC48 FPC2 interface card for the M160 was something like 250K, and that was back in 2002.

[viper0775.livejournal.com]

Walk over to the FBI with your 1,024 pentabyte external storage device and ask them for a copy, that would be a good starting place.. then just rsync the rest ;-)

[noweb4u.livejournal.com]

NSA

[naggy.livejournal.com]

And of course, 90% of the way through, your HD dies.

[torkell]

No, what happens is the server gets bored with a measly 1 GB to go, and then doesn't support resuming downloads. So you have to download the whole lot again from scratch.

[revchris.livejournal.com]

When you're done downloading, can you put a copy on a floppy disk for me?

[hiroe.livejournal.com]

What size? We've got a whole bunch of leftover 8-inch floppies here.

[hiroe.livejournal.com]

..You'd only need some 1.304 trillion of them.

And with a known drive bandwith rate of 60k/s, plus a delay of about 8 seconds to change disks, it'd take about 1.033 million years to store it all.

[revchris.livejournal.com]

No, I want it compressed down to fit on only 1 floppy.

[hisamishness.livejournal.com]

When you get that floppy can you fax me a copy?

[hiroe.livejournal.com]

So just save the Tubgirl image.

[anivair.livejournal.com]

Well, I see all these needless zeroes. cna I compress it down to a fre billionbillion ones for you? that'd probably fit. Now you just need a prpgram capable of putting the zeroes back where they go and we're set!

[revchris.livejournal.com]

Wouldn't it be simpler for you to just write down where all the ones go?

[noweb4u.livejournal.com]

bigger is better! since 1.44MB fit on a 3.5" floppy, 3.3MB fit on an 8" floppy.

:)

[flainn.livejournal.com]

But if you trim down the 8" floppy so it will fit in your 5.25" drive, will you be able to read it? And if not, how long until the tech support person beats you with a clue-by-four?

[noweb4u.livejournal.com]

you can only read part of it if you do that. It's better to go to office depot and buy a 8" floppy drive. Don't ask IT, they'll make something up to avoid having to get you one because they don't even have one that big for themselves, selfish jerks.

Tech support are nice people. I bring them cookies and they help me answer questions about anything, even pets and stuff.

[david-feuer.livejournal.com]

Umm.... If the capacity of the floppy were actually directly related to its area, an 8" floppy would have a capacity of around 7.5MB.

[jjjiii]

I think the internet is being generated faster than a T1 connection downloads at. You could saturate that pipe and the amount of unfilled space in your progress bar would actually grow.

[network-nerd.livejournal.com]

Rule of thumb: A CD takes an hour at T1 speed.

My bet would be that the Internet is growing faster than that.

[the-s-guy.livejournal.com]

With or without the porn?

With porn: 1 trillion years
Without porn: I have it on a floppy disk somewhere

Way back machine

[geekgrrl-ca.livejournal.com]

Some one is already doing this

http://www.archive.org/index.php