Superforecasting Review (Tetlock & Gardner, 2015)
<p>Superforecasting is the most rigorous book in the probabilistic-thinking canon. Unlike most decision-making books that synthesise existing research into a narrative, Superforecasting reports on a specific 4-year research programme - the Good Judgment Project, funded by IARPA - that competitively measured what makes some forecasters dramatically more accurate than others. The findings are practical, actionable, and grounded in data rather than anecdote.</p><p>The book's central claim is that calibration in short-horizon forecasting (months to 18 months out, on political and economic questions) is a learnable skill rather than a fixed trait. The 'superforecasters' - the top 2% of the Good Judgment Project's volunteer forecaster pool - shared a specific set of habits that the rest of us can practise. That makes Superforecasting useful in a way Kahneman's <em>Thinking, Fast and Slow</em> (more diagnostic) and Taleb's <em>Fooled by Randomness</em> (more philosophical) aren't.</p><p>Where it falls short: the narrative-heavy first third can feel slow before the practical material lands, and the findings explicitly cap at ~12-18 month horizons - this isn't a guide to long-range forecasting. For most readers, neither caveat materially detracts. Recommended.</p>
Strengths
- Grounded in 4 years of IARPA-funded competitive forecasting research - data-led, not anecdotal
- 10-commandment framework gives concrete, repeatable practices for improving forecast calibration
- Defines specific habits of top 2% forecasters that contrast with how most people forecast intuitively
Watch outs
- Narrative-heavy first third is slower than the practical material that arrives later
- Findings cap at ~12-18 month horizons - doesn't claim to extend to long-range forecasting
- Limited coverage of organisational forecasting (how to embed superforecasting habits in a team or company)
We may earn a commission if you buy through this link - it never changes the price you pay or our editorial verdict.
What the book is about
Between 2011 and 2015, the Intelligence Advanced Research Projects Activity (IARPA - the US intelligence community's equivalent of DARPA) ran the Good Judgment Project: a competitive forecasting tournament where teams of volunteers made probability estimates on hundreds of geopolitical and economic questions. The tournament was structured as research - the forecasters' calibration could be measured against ground truth, and the top performers identified statistically.
The headline finding: a small group of volunteer forecasters (the top 2%, dubbed 'superforecasters') consistently outperformed serving CIA analysts on the same questions, by a meaningful margin. Across all questions, superforecasters' aggregate calibration was 30% better than the best alternative methodology IARPA could field. The book is built around explaining what the superforecasters did differently, with case studies from the tournament archive.
What the superforecasters actually do
Tetlock and Gardner's 10-commandment framework (Chapter 12 + appendices) captures the practical core. The shorter version is that superforecasters habitually:
Break vague questions into clearer sub-questions with measurable answers.
Anchor on base rates from comparable historical cases before considering the specific case.
Express probability estimates as percentages rather than vague verbal labels ('likely', 'very probable').
Update beliefs in proportion to the strength of new evidence, neither over-reacting nor anchoring stubbornly.
Recognise their own biases - particularly over-confidence, anchoring on initial estimates, and motivated reasoning.
Work in teams when possible - aggregated forecasts beat individuals at the calibration margin.
Treat forecasting as a practice with feedback loops, not a one-shot prediction to be defended later.
None of these habits is exotic. The contribution of the book isn't novelty - it's that Tetlock's team measured the contribution of each habit against forecast accuracy across thousands of forecasts, so the claim that these habits matter rests on data rather than plausibility.
Where the book is strongest
Three things set Superforecasting apart from the typical decision-making book.
Rigour. The Good Judgment Project was a competitive research programme with measurable outputs. Most decision-making books synthesise existing literature; Superforecasting reports on a specific research project where the central claims were tested against tournament results. That difference shows in the confidence of the practical claims.
Actionability. The 10-commandment framework is implementable by individuals without a research team. You can start practising it on personal forecasts - GDP next quarter, election outcomes, the next round of layoffs at your employer - and measure your calibration improvement over weeks. Few decision-making books offer that level of operationalisation.
Honest scope. Tetlock is careful not to overclaim. The findings apply to short-horizon (months to 18 months) forecasts on political and economic questions where ground truth is measurable. He doesn't extend the claims to long-range forecasting or to stockmarket-tip territory. That restraint makes the rest of the claims more credible.
Where it falls short
Three caveats worth noting before buying.
The narrative-heavy first third can feel slow if you came for the practical material. Tetlock and Gardner spend time on the history of forecasting research, the Good Judgment Project's design, and several extended case studies before the 10-commandment framework arrives in Chapter 12. Readers who prefer the practical content can jump to Chapter 11-12 and back-fill the context as needed.
The findings explicitly cap at 12-18 month horizons. The book doesn't claim that superforecasting transfers to long-range forecasting (5-10 year predictions), and it's careful not to suggest the framework works for asset-pricing or any environment where market prices already incorporate forecasters' aggregate beliefs.
Organisational forecasting is under-covered. The book is mostly about individual forecasters and small teams. How to embed superforecasting habits inside a larger organisation - corporate planning, government policy units, intelligence analysis - is a separate practical question the book gestures at but doesn't fully address.
Who should read it
Anyone whose work involves estimating uncertain outcomes
Investors, analysts, founders, product managers, policy researchers, intelligence analysts - all professions where forecast quality affects performance. The 10-commandment framework is directly applicable.
Anyone who's read Thinking, Fast and Slow and wants the next step
Kahneman's book is diagnostic (here are the biases that distort your forecasts). Superforecasting is prescriptive (here are the habits that improve your forecasts). Read in that order.
Anyone leading a team that makes recurring forecasts
The team-level findings (aggregated forecasts beat individuals; calibrated probabilities beat verbal labels; feedback loops matter) are usable without the full research context. Worth reading and putting on a team's recommended-reading list.
Skip if you want long-range or markets-based forecasting
The book is honest about scope. For long-range thinking, Tetlock's earlier Expert Political Judgment (2005) is closer; for markets, Taleb's Fooled by Randomness or The Black Swan address the asset-pricing question this book deliberately avoids.
Frequently asked questions
Q01What is Superforecasting about?
Q02Is Superforecasting still relevant in 2026?
Q03How does Superforecasting compare to Thinking, Fast and Slow?
Q04Can I become a superforecaster?
Q05Does Superforecasting say anything about investing?
Probabilistic Thinking in Daily Life: 7 Practical Uses
Recency Bias
Base-Rate Neglect
