12 Cognitive Biases That Wreck Probability Estimates

The availability heuristic substitutes 'how easily can I think of an example?' for 'how common is this?'. The two questions feel similar but answer different things. Plane crashes are easy to recall because they are reported intensively; car crashes are forgotten because they happen constantly. Asked which is more dangerous per mile travelled, most people get the answer wrong - in the direction the heuristic predicts.

For probability estimates, this matters whenever a rare event is also memorable. Shark attacks, terrorist incidents, lottery wins, founder unicorns, viral product launches - all of them are over-weighted in mental probability tables because the examples come to mind faster than their actual base rates support. The fix is to pause and ask explicitly: how many trials produced these vivid cases?

Our deep-dive: The Availability Heuristic: Why Vivid Examples Mislead.

Anchoring is the tendency to start from whatever number was put in front of you and adjust insufficiently. The classic experiments spin a wheel labelled 0 to 100, then ask participants what percentage of African countries are in the UN. People who saw 65 give higher answers than people who saw 10 - even though the wheel was visibly random.

The probability cost is straightforward: any time you encounter a probability estimate, that number becomes the gravitational centre of your own estimate, even when you 'know' it shouldn't. Negotiation, forecasting, planning poker, project deadlines, market valuations - anywhere the first plausible number gets spoken aloud, the rest of the conversation orbits it. Writing your own estimate down before you hear anyone else's is the most reliable defence.

Our deep-dive: Anchoring Bias: How First Numbers Hijack Judgement.

Confirmation bias is the tendency to seek, weight and remember evidence that supports a hypothesis you already hold, while dismissing or forgetting evidence against it. For probability judgements, this produces estimates that drift systematically toward whichever direction you started leaning - because each new piece of incoming evidence is filtered before it can update your prior.

The most insidious form is asymmetric scepticism: confirming evidence is accepted at face value, disconfirming evidence is interrogated until it can be dismissed. In investment decisions, this is how a thesis you wrote in 2022 still feels correct in 2026 despite the underlying facts having shifted. Pre-mortems and explicit decision journals are the standard counter-measures.

Our deep-dive: Confirmation Bias in Investing: Fight Your Own Brain.

The gambler's fallacy is believing that a sequence of independent random outcomes 'owes' the opposite outcome to balance out. Eight reds in a row at the roulette table feel like black is 'due'. Five girls in a row feel like the next baby is more likely to be a boy. Both intuitions are wrong: independent events do not have memories.

The probability error is structural - it confuses 'long-run frequencies tend toward the underlying probability' (true) with 'individual outcomes adjust to enforce balance' (false). The long run is achieved by averaging over an enormous number of trials, not by reverse-engineering individual outcomes. Recognising independence is the only fix; once you can name the trials as independent, the fallacy dissolves.

Our deep-dive: The Gambler's Fallacy: Why You're Wrong About 'Due' Outcomes.

Hindsight bias is the systematic distortion of past probability estimates after the outcome is known. Asked before the 2016 US election how likely a Trump win was, most pundits gave probabilities below 20%; asked the same question after the election, the same pundits recalled having given probabilities of 40% or higher. The brain quietly rewrites the prior to match the posterior.

For probability estimation, hindsight bias does two damaging things. First, it makes us feel better calibrated than we actually are, because we remember being closer to right than we were. Second, it teaches us false lessons: we update our forecasting habits as though the signal in retrospect was obvious in foresight, which it usually wasn't. Recorded forecasts - dated, with confidence intervals, kept in a journal - are the only durable defence.

Our deep-dive: Hindsight Bias: Why Everything Looks Obvious After the Fact.

Overconfidence in probability estimation usually shows up as confidence intervals that are too narrow. Asked for a 90% confidence range on a numeric question - the length of the Nile, say, or next quarter's revenue - most people give a range that turns out to contain the true answer about 40% of the time, not 90%. The intervals look reasonable from the inside; from the outside, they are wildly under-calibrated.

This bias compounds across probabilistic decisions because each individual overconfident estimate looks defensible on its own. It's only when you record a track record across many decisions - calibration training, essentially - that the pattern becomes visible and fixable. Forecasters who do this regularly become measurably better; everyone else stays roughly as overconfident as they started.

Our deep-dive: Overconfidence Bias: Why Active Traders Underperform.

The conjunction fallacy is judging the probability of two events occurring together as higher than the probability of one of them alone. The classic example: Linda is bright, single, outspoken, and concerned with social justice. Which is more probable - that Linda is a bank teller, or that Linda is a bank teller AND active in the feminist movement? Most people pick the conjunction, even though logically it must be smaller (or equal).

For probability estimation, the conjunction fallacy is what makes detailed forecasts feel more credible than vague ones. A startup pitch that includes specific stages and milestones feels more likely to succeed than the same pitch without them - because each added detail makes the story more vivid, even though each added detail strictly lowers the joint probability. Narrative fluency is not evidence.

There's no dedicated post on the conjunction fallacy yet; the closest treatment is in our guide to probabilistic thinking in everyday life, which covers how to spot it in product roadmaps and life plans.

Survivorship bias distorts probability estimates by sampling only from cases that made it to the present. The famous WWII example: Abraham Wald looked at bullet patterns on bombers returning from missions and recommended armouring the parts that didn't have bullet holes - because the planes hit in those areas had crashed and never came back to be measured.

For probability work, this bias is everywhere. Mutual fund track records exclude the funds that closed. Startup founder advice excludes the founders who went bust. Diet success stories exclude the people the diet didn't work for. The cumulative effect is to overestimate success rates - sometimes by an order of magnitude - because the failures aren't visible in the data set. The fix is to ask explicitly: what does the denominator actually contain?

Our deep-dive: Survivorship Bias: The Hidden Data That Changes Everything.

The prosecutor's fallacy is the conditional-probability error that has wrongfully imprisoned people. A DNA match has a 1-in-a-million false-positive rate, the prosecution argues - so the probability the defendant is innocent is 1 in a million. That's a sleight of hand: 1-in-a-million is P(match given innocent), not P(innocent given match). Reversing the conditioning requires Bayes' theorem and the prior probability of guilt before the test, which is rarely close to 50%.

For everyday probability estimation, the prosecutor's fallacy shows up whenever someone quotes a test's accuracy rate as though it answered the question 'how likely am I to have this condition given a positive result?'. The answer requires the base rate of the condition in your population - and once you include it, the posterior probability is often dramatically lower than the test's headline accuracy suggests.

Our deep-dive: The Prosecutor's Fallacy: How Courts Get Statistics Wrong.

The framing effect distorts the perceived attractiveness of a probability without changing the probability itself. A surgery described as having a 90% survival rate is preferred to the same surgery described as having a 10% mortality rate. A discount described as 'save 20%' is preferred to the same discount described as 'avoid a 20% surcharge'. The numbers are equivalent; the preferences aren't.

For probabilistic decision-making, framing means the same expected-value calculation can produce different choices depending on how the inputs are described. The most robust defence is to translate every framing into both the gain and the loss formulation and check whether your preference flips - if it does, at least one of the two framings is anchoring you onto an irrelevant feature of the description.

Our deep-dive: Framing Effect: Why How You Hear It Changes Your Choice.

Recency bias is the over-weighting of recent observations relative to the longer baseline they sit in. After three months of falling markets, market participants on average estimate the next month's odds of decline higher than the long-run base rate justifies. After a sports team wins a few in a row, fans estimate the probability of the next win above what their season-long record supports. Recency dominates because it's the easiest data to retrieve.

For probability estimation, recency bias produces the same structural error as the availability heuristic but for a specific reason - recent events are available because they're recent, not because they're representative. The defence is to formally specify the window your estimate should use (e.g. 'season-to-date win rate', 'rolling 12-month inflation') before looking at the recent data, so the data feeds a defined estimator rather than your gut.

Our deep-dive: Recency Bias in Investing and Sports Predictions.

Across all twelve biases, three defences keep showing up in the research on improved calibration:

1. Write down your estimate before reading the evidence. This neutralises anchoring (you set your own anchor first), confirmation bias (you commit to a position you must defend against new evidence), and hindsight bias (you have a record of what you thought when you didn't know the outcome).
2. State the base rate explicitly. Most probability errors collapse once you write the prior down. Base-rate neglect, the prosecutor's fallacy, and survivorship bias all become visible once you ask 'what does the denominator contain?'.
3. Track your calibration over many decisions. Overconfidence, recency bias and availability all hide in any single decision; they're only visible across a track record. Decision journals, prediction markets and structured forecasting tournaments all work because they make the track record legible.

The deeper move is to treat probability estimation as a separate cognitive task from intuitive judgement - one that benefits from explicit tools (Bayes' theorem, calibration scoring, expected-value formulas) rather than reflex. Our decision-journal guide covers the practical version of this for everyday decisions, and the calibration training guide covers the structured-practice version for people who want to get measurably better at the underlying skill.

The underlying research for the twelve biases above:

• Tversky, A. & Kahneman, D. (1974). Judgment under Uncertainty: Heuristics and Biases. Science, 185(4157), 1124-1131. The foundational paper for base-rate neglect, availability, anchoring and adjustment.
• Tversky, A. & Kahneman, D. (1983). Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment. Psychological Review, 90(4), 293-315. The Linda problem and the original conjunction-fallacy experiments.
• Fischhoff, B. (1975). Hindsight is not equal to foresight. The original 'I knew it all along' studies.
• Wald, A. (1943). A method of estimating plane vulnerability based on damage of survivors. The WWII bomber survivorship-bias analysis.
• Thompson, W. C. & Schumann, E. L. (1987). Interpretation of statistical evidence in criminal trials: The prosecutor's fallacy and the defense attorney's fallacy. Law and Human Behavior, 11(3), 167-187.
• Tversky, A. & Kahneman, D. (1981). The framing of decisions and the psychology of choice. Science, 211(4481), 453-458.