Analytics Team » data warehousing http://www.analyticsteam.com Predictive analytics, data mining, business intelligence and more. Information useful to analysts and data people of all kinds Mon, 06 Feb 2012 05:07:05 +0000 en hourly 1 http://wordpress.org/?v=3.3.1 Managing mountains of data http://www.analyticsteam.com/2011/10/18/managing-mountains-of-data/ http://www.analyticsteam.com/2011/10/18/managing-mountains-of-data/#comments Wed, 19 Oct 2011 03:58:38 +0000 http://www.analyticsteam.com/?p=1240 Check out this Computer World article. They’ve got some stories about the following companies/organizations and their usage of data:

  • Library of Congress
  • Amazon.com
  • Mazda Motor Corp.
  • The Nielsen Company
]]> http://www.analyticsteam.com/2011/10/18/managing-mountains-of-data/feed/ 0 Orbitz chooses cloud-based data warehouse solution http://www.analyticsteam.com/2011/10/11/orbitz-chooses-cloud-based-data-warehouse-solution/ http://www.analyticsteam.com/2011/10/11/orbitz-chooses-cloud-based-data-warehouse-solution/#comments Wed, 12 Oct 2011 04:26:02 +0000 http://www.analyticsteam.com/?p=1197 Travel site, Orbitz, has outsources part of it’s data infrastructure to Kognitio. Check out the GigaOm article. Orbitz is also a big user of Hadoop as shown in these slides:

Hadoop and Hive at Orbitz, Hadoop World 2010

]]> http://www.analyticsteam.com/2011/10/11/orbitz-chooses-cloud-based-data-warehouse-solution/feed/ 0 IBM builds 120PB cluster of 200,000 hard disks http://www.analyticsteam.com/2011/09/03/ibm-builds-120pb-cluster-of-200000-hard-disks/ http://www.analyticsteam.com/2011/09/03/ibm-builds-120pb-cluster-of-200000-hard-disks/#comments Sun, 04 Sep 2011 02:23:08 +0000 http://www.analyticsteam.com/?p=1019 IBM Research has developed a hardware and software solution to join 200,000 hard disks together into a single 120 petabyte storage cluster.  Here’s an article from ExtremeTech and here’s one from O’Reilly Radar with more details.  As of last year, Facebook had the worlds largest Hadoop cluster at 21 petabytes.  This IBM cluster is for a customer, likely a government agency.

]]> http://www.analyticsteam.com/2011/09/03/ibm-builds-120pb-cluster-of-200000-hard-disks/feed/ 0 Open hardware http://www.analyticsteam.com/2011/08/26/open-hardware/ http://www.analyticsteam.com/2011/08/26/open-hardware/#comments Fri, 26 Aug 2011 15:21:33 +0000 http://www.analyticsteam.com/?p=991 Check out this VentureBeat article about Facebook open sourcing the hardware in their data center through the Open Compute Project.

]]> http://www.analyticsteam.com/2011/08/26/open-hardware/feed/ 0 Facebook moves 30 petabytes of Hadoop data http://www.analyticsteam.com/2011/07/28/facebook-moves-30-petabytes-of-hadoop-data/ http://www.analyticsteam.com/2011/07/28/facebook-moves-30-petabytes-of-hadoop-data/#comments Fri, 29 Jul 2011 01:05:35 +0000 http://www.analyticsteam.com/?p=979 Strata describes the process Facebook recently went through to move 30 petabytes of Hadoop data from one data center to another.

]]> http://www.analyticsteam.com/2011/07/28/facebook-moves-30-petabytes-of-hadoop-data/feed/ 0 Hadoop hardware http://www.analyticsteam.com/2011/06/05/hadoop-hardware/ http://www.analyticsteam.com/2011/06/05/hadoop-hardware/#comments Mon, 06 Jun 2011 03:08:49 +0000 http://www.analyticsteam.com/?p=954 If you’re interested in using Hadoop as a tool within your enterprise, it can be quite an endeavor – figuring out what software components you need, what configuration you need, and what hardware it should run on. Lots of people are running different configurations and while the community does share a lot of information, there aren’t many good recaps of hardware being used. Monash Research has a good writeup that also compares how Hadoop hardware has changed over the past couple years.

]]> http://www.analyticsteam.com/2011/06/05/hadoop-hardware/feed/ 0 Sum of world knowledge is 295 exabytes http://www.analyticsteam.com/2011/02/12/sum-of-world-knowledge-is-295-exabytes/ http://www.analyticsteam.com/2011/02/12/sum-of-world-knowledge-is-295-exabytes/#comments Sun, 13 Feb 2011 05:39:12 +0000 http://www.analyticsteam.com/?p=823 Scientists have estimated that to store the sum of all the world’s knowledge would take up 295 exabytes. Check out the BBC article.

]]> http://www.analyticsteam.com/2011/02/12/sum-of-world-knowledge-is-295-exabytes/feed/ 0 Planning for derived data http://www.analyticsteam.com/2010/12/31/planning-for-derived-data/ http://www.analyticsteam.com/2010/12/31/planning-for-derived-data/#comments Fri, 31 Dec 2010 18:16:44 +0000 http://www.analyticsteam.com/?p=755 Since by definition, derived data is based on lower level raw data, it could be derived again as needed. DBMS2 takes us through some thinking about how better to handle derived data.

]]> http://www.analyticsteam.com/2010/12/31/planning-for-derived-data/feed/ 0 Cloudera and EMC Greenplum form data warehouse alliance http://www.analyticsteam.com/2010/09/22/cloudera-and-emc-greenplum-form-data-warehouse-alliance/ http://www.analyticsteam.com/2010/09/22/cloudera-and-emc-greenplum-form-data-warehouse-alliance/#comments Thu, 23 Sep 2010 03:30:00 +0000 http://www.analyticsteam.com/?p=692 Cloudera has formed an integration alliance with Greenplum. Cloudera will integrate their distribution of Hadoop with Greenplum’s Chorus product. Read more at ZDNet.

]]> http://www.analyticsteam.com/2010/09/22/cloudera-and-emc-greenplum-form-data-warehouse-alliance/feed/ 0 IBM to acquire Netezza http://www.analyticsteam.com/2010/09/20/ibm-to-acquired-netezza/ http://www.analyticsteam.com/2010/09/20/ibm-to-acquired-netezza/#comments Tue, 21 Sep 2010 01:09:58 +0000 http://www.analyticsteam.com/?p=684 IBM has just announce they intend to purchase Netezza. Check out the press release.

And check out DBMS2 and Techcrunch for some comments.

]]> http://www.analyticsteam.com/2010/09/20/ibm-to-acquired-netezza/feed/ 0