Analytics Team » data mining

Social graph analysis reveals slumloard conspiracy

Sat, 07 Jan 2012 21:26:52 +0000

Check out this Boing Boing post to see how a social graph analysis from OrgNet shows that slumlords work together to avoid maintenance on the buildings they buy and sell.

Waffles – command line tools for machine learning and data mining

Sun, 25 Dec 2011 05:09:30 +0000

If you’re in to machine learning and data mining, then Waffles might be just what you need. Waffles is a collection of command line tools for machine learning and data mining.

The CIA mines Twitter and Facebook

Sun, 06 Nov 2011 02:55:55 +0000

It’s not surprising but, the CIA is mining the full stream of Twitter and Facebook messages from a special facility they’ve set up in Virginia. Read the details.

A site to test your analytics skills (and win money)

Fri, 04 Nov 2011 22:02:13 +0000

We’ve written about Kaggle before, but here’s a new post from the New York Times about the site and some new funding they’ve received.

HP mines data to predict consumer behavior

Sat, 29 Oct 2011 22:14:23 +0000

Here’s an Information Week article talking about how HP used data mining to predict consumer behavior. The project was completed by HP Labs and HP Global Customer Intelligence.

Using data mining for image processing

Wed, 26 Oct 2011 04:43:20 +0000

Most discussions about data mining are related to systematically finding patterns or correlations in large data sets. There are also applications for data mining in comparing images to find similarities. Check out the explanation.

Text mining for predicting revolution

Fri, 30 Sep 2011 04:46:36 +0000

By mining the past 30 years of news stories, a new computer system can help identify when and where a revolution is likely to occur. The two main techniques used included sentiment analysis and “full-text geocoding” to match to a location. The process runs on the SGI Altix supercomputer Nautilus. Read the SingularityHub article for more info.

Data Scientist: the hottest job

Sat, 10 Sep 2011 03:47:53 +0000

AOL has a new article on their job board about the Data Scientist, calling the role “the hottest job you haven’t heard of.” While it may be a bit of a buzzword, the idea has been around for a while. Here are a few other references to the term Data Scientist or Data Science…

Data scientist: The hot new gig in tech – Fortune – September 2011
EMC Data Scientist Summit
What is Data Science – O’Reilly Media – June 2010
Rise of the Data Scientist – FlowingData – June 2009

Reid Hoffman’s view on data

Thu, 17 Mar 2011 03:24:04 +0000

Check out what LinkedIn founder, Reid Hoffman, has to say to say to Venture Beat about the new world of data. He lists off a few companies that he thinks are making good use of data.

Pattern web mining module

Fri, 25 Feb 2011 21:53:19 +0000

CLIPS (Computational Linguistics & Psycholinguistics) has released a new module for web mining for Python called Patterns.

Quoting from the CLIPS site:

It bundles tools for data retrieval (Google + Twitter + Wikipedia API, web spider, HTML DOM parser), text analysis (rule-based shallow parser, WordNet interface, syntactical + semantical n-gram search algorithm, tf-idf + cosine similarity + LSA metrics) and data visualization (graph networks).

Visit their site to get the download.