The Glory of Big Data

Discussion in 'Computer Science & Culture' started by KilljoyKlown, Nov 14, 2011.

Thread Status:
Not open for further replies.
  1. KilljoyKlown Whatever Valued Senior Member

    Messages:
    6,493
    Until I read this article I never heard of a zettabyte before (proof you can never have enough storage). However I am now wondering if we will ever be able to catch up on our ability to analyze all the data we are creating year after year.

    http://www.popsci.com/technology/article/2011-10/glory-big-data
     
  2. Google AdSense Guest Advertisement



    to hide all adverts.
  3. scheherazade Northern Horse Whisperer Valued Senior Member

    Messages:
    3,798
    Does this qualify as verification that life as we know it is nothing more than 'Trivial Pursuit' on the mega-scale, and that we are all born 'players'?

    Please Register or Log in to view the hidden image!

     
  4. Google AdSense Guest Advertisement



    to hide all adverts.
  5. KilljoyKlown Whatever Valued Senior Member

    Messages:
    6,493
    Damn! I was never that good at Trivial Pursuit. But I would like to know what comes after zettabyte? Just in case I'm still alive when I hear the term for that much data.

    Please Register or Log in to view the hidden image!

     
  6. Google AdSense Guest Advertisement



    to hide all adverts.
  7. KilljoyKlown Whatever Valued Senior Member

    Messages:
    6,493
    Never mind I found the answer.

    What comes after zettabyte?

    The yottabyte (derived from the SI prefix yotta-) is a unit of information or computer storage equal to one septillion (one long scale quadrillion or 1024) bytes (one quadrillion gigabytes). The unit symbol for the yottabyte is YB.

    After Terabyte comes a Petabyte then Exabyte then Zettabyte then Yottabyte
    (not spelled after the great Jedi Master :-(

    (interesting fact: 2 Pedabytes would store the entire contents of ALL US
    academic libraries).

    Megabyte = 1/1152921504606846976 yottabyte
    = 1/1125899906842624 zettabyte
    = 1/1099511627776 exabyte
    = 1/1073741824 petabyte
    = 1/1048576 terabyte
    = 1/1024 gigabyte
    = 1 megabyte
    = 8 Megabits
    = 1024 kilobytes
    = 8192 Kilobits
    = 1048576 bytes
    = 2097152 nibbles
    = 8388608 bits

    gigabyte = 1/1125899906842624 yottabyte
    = 1/1099511627776 zettabyte
    = 1/1073741824 exabyte
    = 1/1048576 petabyte
    = 1/1024 terabyte
    = 1 gigabyte
    = 1024 megabytes
    = 8192 Megabits
    = 1048576 kilobytes
    = 8388608 Kilobits
    = 1073741824 bytes
    = 2147483648 nibbles
    = 8589934592 bits

    terabyte = 1/1099511627776 yottabyte
    = 1/1073741824 zettabyte
    = 1/1048576 exabyte
    = 1/1024 petabyte
    = 1 terabyte
    = 1024 gigabytes
    = 1048576 megabytes
    = 8388608 Megabits
    = 1073741824 kilobytes
    = 8589934592 Kilobits
    = 1099511627776 bytes
    = 2199023255552 nibbles
    = 8796093022208 bits

    petabyte = 1/1073741824 yottabyte
    = 1/1048576 zettabyte
    = 1/1024 exabyte
    = 1 petabyte
    = 1024 terabytes
    = 1048576 gigabytes
    = 1073741824 megabytes
    = 8589934592 Megabits
    = 1099511627776 kilobytes
    = 8796093022208 Kilobits
    = 1125899906842624 bytes
    = 2251799813685248 nibbles
    = 9007199254740992 bits

    Exabyte = 1/1048576 yottabyte
    = 1/1024 zettabyte
    = 1 exabyte
    = 1024 petabytes
    = 1048576 terabytes
    = 1073741824 gigabytes
    = 1099511627776 megabytes
    = 8796093022208 Megabits
    = 1125899906842624 kilobytes
    = 9007199254740992 Kilobits
    = 1152921504606846976 bytes
    = 2305843009213693952 nibbles
    = 9223372036854775808 bits

    Zettabyte = 1/1024 yottabyte
    = 1 zettabyte
    = 1024 exabytes
    = 1048576 petabytes
    = 1073741824 terabytes
    = 1099511627776 gigabytes
    = 1125899906842624 megabytes
    = 9007199254740992 Megabits
    = 1152921504606846976 kilobytes
    = 9223372036854775808 Kilobits
    = 1180591620717411303424 bytes
    = 2361183241434822606848 nibbles
    = 9444732965739290427392 bits

    yottabyte = 1 yottabyte
    = 1024 zettabytes
    = 1048576 exabytes
    = 1073741824 petabytes
    = 1099511627776 terabytes
    = 1125899906842624 gigabytes
    = 1152921504606846976 megabytes
    = 9223372036854775808 Megabits
    = 1180591620717411303424 kilobytes
    = 9444732965739290427392 Kilobits
    = 1208925819614629174706176 bytes
    = 2417851639229258349412352 nibbles
    = 9671406556917033397649408 bits
     
  8. KilljoyKlown Whatever Valued Senior Member

    Messages:
    6,493
    But now I want to know what nibbles are between bits and bytes? They seem to be low enough down on the list that I should have heard about them by now.:shrug:
     
  9. scheherazade Northern Horse Whisperer Valued Senior Member

    Messages:
    3,798
    When one contemplates the scale of life as we presently know it, and how recently our species actually evolved written language and began to record our history and observations, now advancing to digital data, the number of zeros after the numeral is nothing more than a tribute to our human vanity.

    We have barely scratched the frost on the window pane, that we might peer at the larger picture beyond, IMO.

    At the presently increasing rate of proliferation of information, there's a reasonably good chance that you may come to know what follows zettabyte, KJ.

    Please Register or Log in to view the hidden image!

     
  10. scheherazade Northern Horse Whisperer Valued Senior Member

    Messages:
    3,798
    See? That was quick, LOL.....

    Please Register or Log in to view the hidden image!

     
  11. KilljoyKlown Whatever Valued Senior Member

    Messages:
    6,493
    Okay I found more.

    Please Register or Log in to view the hidden image!



    What comes after a Yottabyte?


    Share



    1024 Bytes = 1 Kilobyte

    1024 Kilobytes = 1 Megabyte

    1024 Megabytes = 1 Gigabyte

    1024 Gigabytes = 1 Terabyte

    1024 Terabytes = 1 Petabyte

    1024 Petabytes = 1 Exabyte

    1024 Exabytes = 1 Zettabyte

    1024 Zettabyte = 1 Yottabyte

    What comes after 1 Yottabyte? Well, there have been some proposals put forward for the following, and apparently a decision should have been made this year in order to finalize these terms:

    1024 Yottabytes = 1 Brontobyte

    1024 Brontobytes = 1 Geobyte

    1024 Geobytes = 1 Zotzabyte

    According to CSIRO, in the next decade, astronomers expect to be processing 10 petabytes of data every hour from the Square Kilometre Array telescope. The telescope is expected to generate around 1 exabyte of data every four days. According to Cisco, annual global IP traffic for 2013 is estimated to be around 667 exabytes. With augmented reality on its way and a number of other exciting things, I’m estimating global IP traffic to be around a couple 100 Zotzabytes by 2018.
     
  12. KilljoyKlown Whatever Valued Senior Member

    Messages:
    6,493
    As long as we are on big data it's only fair to include big numbers.

    The names for larger numbers, based on the "short scale" where each value is a multiple of 1000:

    1,000 X 1 thousand = 1 million (106)
    1,000 X 1 million = 1 billion (109)
    1,000 X 1 billion = 1 trillion (1012)
    1,000 X 1 trillion = 1 quadrillion (1015)
    1,000 X 1 quadrillion = 1 quintillion (1018)
    1,000 X 1 quintillion = 1 sextillion (1021)
    1,000 X 1 sextillion = 1 septillion (1024)
    1,000 X 1 septillion = 1 octillion (1027)
    1,000 X 1 octillion = 1 nonillion (1030)
    1,000 X 1 nonillion = 1 decillion (1033)
    1,000 X 1 decillion = 1 undecillion (1036)
    1,000 X 1 undecillion = 1 duodecillion (1039)

    Other very large numbers are:
    One googol = 10100
    One googolplex = 10googol
    One googolplexian = 10googolplex

    Even larger numbers exist. One is called "Graham's Number", which is so large that it could never be written out using ordinary number notations.

    Read more: http://wiki.answers.com/Q/What_are_the_numbers_that_come_after_a_trillion#ixzz1dpDJNCZx
     
  13. leopold Valued Senior Member

    Messages:
    17,455
    a nibble is 4 bits, half a byte.
     
  14. GeoffP Caput gerat lupinum Valued Senior Member

    Messages:
    22,087
    Isn't that just storage?

    Analysis-wise, bigger is getting more common, but analysis is still pretty fast. On my cheesy, 4-yr old machine, I run 40,000 individuals for 15 traits and a dozen covariates in about 5 seconds. Throw in a million SNP chip and maybe you'd have a two-day run for a univariate model. But that much data takes up less than a gig. Only solution: fill the available space with more breeding and more assays.
     
  15. quadraphonics Bloodthirsty Barbarian Valued Senior Member

    Messages:
    9,391
    Yeah, popular amongst embedded programmers and hackers who express numbers in hexidecimal - in that case, each digit represents 4 bits, or 1 nibble.
     
  16. KilljoyKlown Whatever Valued Senior Member

    Messages:
    6,493
    Yeah! I got that much, but I've been working with computers for 40 years now and this is the first I've ever heard of a nibble.
     
  17. leopold Valued Senior Member

    Messages:
    17,455
    since BCD, HEX, and the archaic octal use 4 bits they had to call it something.
    i found out about nibbles during my college days, back in the early 80s.
     
  18. KilljoyKlown Whatever Valued Senior Member

    Messages:
    6,493
    The article stated the total world data went up 1.2 zettabytes last year and will go up 1.8 zettabytes this year and so on and on. This is a very diverse data and doesn't lend itself to easy analysis. Just the data we are pulling in from all our space activities takes many years of analysis, so we are always playing catch up. The information is coming in faster than we can process it all. Sure we prioritize, but that will mean a very big pool of data will be left waiting who knows how long if ever.

    Even as fast as our storage and processing power is advancing, it's way to slow to keep up.
     
  19. KilljoyKlown Whatever Valued Senior Member

    Messages:
    6,493
    I think I may have heard one of the other names it went by or something or it just wasn't something I needed to remember so I didn't.
     
Thread Status:
Not open for further replies.

Share This Page