Figuring out what to read (and what to believe) about Big Data is becoming a Big Data problem in and of itself¹. I wrote The hype, benefits, and dangers of Big Data a while ago to give an overview of what’s out there, but there are two more interesting articles from the last week that I’d like to highlight as well.

First, on the HBR blog Jake Porway talks about Big Data and social entrepreneurship and makes the point that You Can’t Just Hack Your Way to Social Change:

Any data scientist worth their salary will tell you that you should start with a question, NOT the data. Unfortunately, data hackathons often lack clear problem definitions. Most companies think that if you can just get hackers, pizza, and data together in a room, magic will happen. This is the same as if Habitat for Humanity gathered its volunteers around a pile of wood and said, “Have at it!” By the end of the day you’d be left with half of a sunroom with 14 outlets in it.

And on Wired, Does ‘Big Data’ Mean the Demise of the Expert — And Intuition? is a very interesting excerpt from Viktor Mayer-Schönberger and Kenneth Cukier’s new book on the topic:

In the same spirit, the biggest impact of big data will be that data-driven decisions are poised to augment or overrule human judgment.

The subject-area expert, the substantive specialist, will lose some of his or her luster compared with the statistician and data analyst, who are unfettered by the old ways of doing things and let the data speak. This new cadre will rely on correlations without prejudgments and prejudice. To be sure, subject-area experts won’t die out, but their supremacy will ebb. From now on, they must share the podium with the big-data geeks, just as princely causation must share the limelight with humble correlation.

It seems like an obvious conclusion, but everything I’ve read so far about Big Data confirms that if we think cutting the “messiness” of human decision-making out of data analysis will result in better decisions, we’re sorely mistaken.