Google Sorts 1 Petabyte In 6 Hours 166
krewemaynard writes "Google has announced that they were able to sort one petabyte of data in 6 hours and 2 minutes across 4,000 computers. According to the Google Blog, '... to put this amount in perspective, it is 12 times the amount of archived web data in the US Library of Congress as of May 2008. In comparison, consider that the aggregate size of data processed by all instances of MapReduce at Google was on average 20PB per day in January 2008.' The technology making this possible is MapReduce 'a programming model and an associated implementation for processing and generating large data sets.' We discussed it a few months ago. Google has also posted a video from their Technology RoundTable discussing MapReduce."
Kudos to Google (Score:5, Funny)
for knowing how important the Library of Congress metric is to us nerds!
Unit conversion (Score:5, Funny)
Yay! We finally have unit conversion from 1 LoC to bytes! So...20 PB = 6LoC, means that 1 LoC = 3,333... PB :)
Finally... (Score:5, Funny)
I will be able to catalog my pr0n in my lifetime:
Blondes, Brunettes, Red heads, Beastial^H^H^H^H^H "Other"
Re:That's Easy (Score:5, Funny)
And yet google don't even convert petabytes to libraries of congress in the google calculator.
Or perhaps I got the syntax wrong.
Re:That's Easy (Score:5, Funny)
Huh? This isn't the parent post I was trying to reply to.
Its About Time.... (Score:2, Funny)
Finaly... A system with enough power to run vista efficiently.
Re:Finally... (Score:2, Funny)
Not impressive... (Score:5, Funny)
Re:tagging (Score:5, Funny)
pr0n for Geeks, volume 18: Sorting On-the-Fly
0s and 1s (Score:2, Funny)
That's a lot of computing power to use just to get 4,000,000,000,000 0s and 4,000,000,000,000 1s.
nice one, Google... (Score:2, Funny)
...fancy doing my mp3 collection?
Re:Its About Time.... (Score:4, Funny)
Not only that the extra processors aren't covered under the EULA and require special extra licenses.
Re:Sort? Sort what? (Score:5, Funny)
Re:Kudos to Google (Score:5, Funny)
for knowing how important the Library of Congress metric is to us nerds!
But at least now we know Google can sort out petafiles.
Re:Kudos to Google (Score:5, Funny)
Amazing feat... (Score:5, Funny)
Today from Google, the god of all things and doer of all things good in the universe, many millions of dollars in computer equipment were able to sort lots of things, in about the amount of time you would think it would take for millions of dollars of equipment to sort things.
In other news, a woodchuck was found chucking wood as fast as a woodchuck could chuck wood.
Congrats Google, you have a HUGE data set, and an even bigger wallet.
Re:Unit conversion (Score:2, Funny)
Re:Kudos to Google (Score:4, Funny)
So Google can sort through 12 LoCs in 6 hours.
Wow, that's 2 LoC/pH
Re:BCA's? (Score:3, Funny)
Sure, it's -4.15 Edsels.
Re:Kudos to Google (Score:1, Funny)
Woooosh, dipshit.
USSR (Score:1, Funny)
In Soviet Russia, 6 petabytes sort YOU in ONE hour.