It’s not surprising but, the CIA is mining the full stream of Twitter and Facebook messages from a special facility they’ve set up in Virginia. Read the details.
Sep 03
IBM Research has developed a hardware and software solution to join 200,000 hard disks together into a single 120 petabyte storage cluster. Here’s an article from ExtremeTech and here’s one from O’Reilly Radar with more details. As of last year, Facebook had the worlds largest Hadoop cluster at 21 petabytes. This IBM cluster is for a customer, likely a government agency.
Aug 26
Check out this VentureBeat article about Facebook open sourcing the hardware in their data center through the Open Compute Project.
Jul 28
Strata describes the process Facebook recently went through to move 30 petabytes of Hadoop data from one data center to another.

