Big Data: A Revolution That Will Transform How We Live, Work, and Think

Big Data: A Revolution That Will Transform How We Live, Work, and Think argues that we are entering a new era in which the sheer scale of available data changes not just what we know but how we know it. Mayer-Schönberger and Cukier show how using all the data (N=all) instead of samples, accepting messiness instead of demanding precision, and embracing correlation instead of obsessing over causation unlocks enormous new economic and social value—from predicting flu outbreaks and airfare prices to preventing infrastructure failures and saving premature babies. Through vivid examples (Google Flu Trends, Farecast, Amazon recommendations, exploding manholes), the authors explain the mechanics of datafication—rendering ever more aspects of reality into quantifiable, analyzable form—and reveal how data's value increasingly lies in its reuse and option value. But they also confront the dark side: the erosion of privacy, the menace of punishing people for predicted (not actual) behavior, and the danger of a 'dictatorship of data.' The book offers a framework for governance—shifting from individual consent to data-user accountability, safeguarding human agency, and creating a new profession of 'algorithmists.' It is at once an enthusiastic primer, a business strategy guide, and a cautionary meditation on humanity's place amid a quantifiable world.

What it argues

Big Data: A Revolution That Will Transform How We Live, Work, and Think

Key ideas it contributes

• Using All the Data (N=all) — The practice of analyzing the comprehensive or near-comprehensive dataset relating to a phenomenon rather than relying on a statistical sample, enabling granular insights into subgroups and outliers that sampling cannot reveal.
• Embracing Messiness (Imprecision Tolerance) — The willingness to accept inexactitude, inconsistency, and lower-quality data in exchange for far larger volumes, trading micro-level accuracy for macro-level insight and the ability to capture unstructured information.
• Prioritizing Correlation Over Causation — The analytic orientation toward identifying statistical associations and useful proxies (knowing what) rather than insisting on understanding underlying causal mechanisms (knowing why), enabling faster and cheaper insights and predictions.
• Datafication — The process of rendering aspects of the world—location, sentiment, posture, relationships, behaviors—into quantified, tabulated, analyzable data formats, distinct from mere digitization, thereby unlocking latent informational value for new uses.
• Big-Data Mindset — The cognitive orientation that recognizes latent and option value in data, imagines novel secondary uses, and frees itself from conventional thinking about what is feasible, often held by creative outsiders rather than domain incumbents.
• Data Reuse and Recombination — The behavioral pattern of applying collected data to multiple purposes beyond its primary use—through basic reuse, merging datasets, extensibility, and capturing data exhaust—thereby releasing data's latent option value.
• Prediction-Based Decision-Making — The behavioral shift toward augmenting or overruling human judgment with data-driven predictions and correlations, replacing intuition and subject-expertise with statistical models in operational and managerial decisions.
• Economic Value Creation — The outcome whereby big data becomes a vital economic input and corporate asset, generating new goods, services, business models, productivity gains, and competitive advantage for those who hold and analyze data effectively.
• Predictive Accuracy and Insight — The outcome of improved ability to forecast events, detect anomalies, identify trends, and prevent problems—such as flu spread, equipment failure, infection onset, or fire risk—through large-scale correlational analysis.
• Privacy Erosion — The risk outcome whereby the scale and reuse of personal data, combined with the failure of anonymization, notice-and-consent, and opting out, exposes individuals to surveillance and re-identification.
• Loss of Human Agency (Predictive Punishment) — The risk outcome whereby big-data predictions of future behavior are used to judge and punish individuals for propensities rather than actions, negating free will, individual responsibility, and the presumption of innocence.
• Dictatorship of Data — The risk outcome of fetishizing data and predictions—becoming mindlessly bound by analytic output, collecting data for its own sake, or attributing undeserved truth to figures—leading to misuse and impoverished judgment, as exemplified by McNamara's body counts.
• Governance Safeguards — The contextual mechanisms—shifting privacy from consent to data-user accountability, protecting human agency, employing algorithmists, and applying antitrust-style regulation—designed to contain big data's risks while enabling its benefits.