Regression Toward the Mean: Why Big Wins and Bad Days Don't Last

Regression toward the mean is one of the most common — and most misunderstood — phenomena in everyday life. People often mix it up with the gambler’s fallacy or with causal stories (e.g., “they must have gotten lucky” or “they must be slacking now”). In plain terms, regression toward the mean is a statement about probabilities: after an extreme observation, a less extreme observation is usually much more likely than an even more extreme one.

A short history

The phrase and idea trace back to Sir Francis Galton in the late 19th century, who noticed that tall parents tend to have children who are tall but closer to average, and short parents tend to have children who are short but closer to average. Over the next century, statisticians formalized the idea in terms of sampling distributions and expectation, and it became central to understanding measurement variability, reliability, and prediction. The historical takeaway is that what looked like a biological “pull” toward the average was really a probabilistic pattern arising from variability and imperfect correlations between measurements.

Regression toward the mean as a probability comparison

At its core, regression toward the mean is not a mysterious force; it’s a simple comparison of probabilities — and because most measurements in daily life are roughly bell-shaped (approximately normal), those probability comparisons overwhelmingly favor outcomes closer to the mean. And for a normal-like distribution, the bulk of outcomes cluster near the mean, giving the familiar 68–95–99.7 rule: about 68% of outcomes fall within ±1σ of the mean, 95% within ±2σ, and 99.7% within ±3σ.

Standard normal distribution (bell curve) centered at 0; red band ±1σ ≈ 68%, light pink bands ±2σ ≈ 95%, light blue bands ±3σ ≈ 99.7%; tiny tails beyond ±3σ.
The 68-95-99.7 rule: a standard normal curve showing ~68% within ±1σ, ~95% within ±2σ, and ~99.7% within ±3σ.

Suppose a measurement X has a true long-run distribution with mean μ and some variability (standard deviation σ). If you observe an extreme value x far from μ, the distribution of a fresh, independent draw from the same process still centers on μ. That second draw is simply more likely to fall closer to μ than to be even farther out.

Animated normal curve showing probability within distance d of the mean versus outside d and the changing ratio of inside-to-outside probability.
Inside vs Outside d from the mean of Normal Distribution, also shows the ratio of these two probabilities.

Concrete classroom example: a student truly masters 80% of a large problem pool. If an exam picks 100 problems at random, the student’s score follows a Binomial distribution with parameters N=100 and p=0.8. Extreme scores (very high or very low) are possible, but unlikely. If the student scored 90 on one test (an extreme positive outcome), the next independent test still follows the same Binomial distribution: scores closer to 80 are far more likely than scores even farther from 80 (like 95 or 65).

Animated GIF showing a sampling distribution (Binomial/N≈normal); a single previous score is highlighted, then the full next-test distribution appears unchanged; animation emphasizes that extreme prior scores have small probability mass and that most next scores lie nearer the mean.
Whatever the previous score was, the next independent score follows the same Binomial (or its normal approximation); extreme previous scores are rare, so next scores are much more likely to fall closer to the true mean.


For most everyday examples and many practical purposes, the Binomial can be well approximated by a normal distribution when the rule-of-thumb N*p≥5 and N*(1-p)≥5 holds, as shown in the following image. 


Binomial distribution (N=100, p=0.8) overlaid with a red normal curve labeled μ=80, σ=4; x-axis 0–100, y-axis 0–0.10; illustrates close match between Binomial and normal approximation and highlights that values near 80 dominate while values like 90 are rare.
Binomial (N = 100, p = 0.8) with its normal approximation (μ = 80, σ = 4); the discrete distribution and smooth curve show how the Binomial closely matches a normal shape for the test score case.


The intuition: being 3σ above the mean is rare; the probability mass even farther out is tiny. So after seeing an extreme, the odds strongly favor a next score that’s closer to the mean rather than still more extreme. This is a ratio/ comparison of probabilities, not a statement that the process “wants” the mean more than before.

When regression toward the mean can fail or reverse

Regression toward the mean depends on the shape of the underlying distribution and on independence between measurements.

If the distribution is multi-modal or heavily skewed, an extreme value in one mode might be followed by another value in the same distant mode, making “regression” less evident or even producing apparent divergence for some ranges. Like the following example, the distribution is a mixture of two normal distributions and one beta distribution. Luckily, most everyday measurements follow an approximately normal, bell-shaped pattern, so the usual regression‑toward‑the‑mean intuition holds in most practical cases.

Multimodal probability density with three peaks; ~45% of mass within ±1σ and ~55% in the tails, dashed lines at ±σ.
A multimodal distribution: multiple peaks produce less mass near the center (≈45% within ±1σ) and more weight in distant modes, so values can remain far from the overall mean rather than regressing toward it at least for one σ from the mean.


Dependence matters: if measurements are not independent — true skill changes, learning effects, carelessness after success, carefulness after failure, fatigue, selection effects — then future outcomes aren’t just resampled from the same underlying distribution. In those cases, you must separate regression from real change. Regression toward the mean can sometimes reflect genuine causes (for example, learning or skill decay), but it also follows purely from chance — even when nothing real has changed, extreme observations are statistically likely to be followed by values closer to the average.

Always ask: Are you comparing independent draws from the same process, or is the process itself changing after the extreme observation?

Everyday examples

Sports: A player who has an unusually great season often posts a less extreme season afterwards. That’s frequently a mixture of regression toward the mean (performance variability) and some real effects (injury, aging).  

Investing: a stock or fund that dramatically outperforms in one year is statistically unlikely to match that same outperformance the next year because returns are noisy and short-term winners often reflect luck or transient conditions. Over long periods, this tendency helps explain why an equal-weighted index fund can outperform market-cap-weighted ones: cap-weighting concentrates on the recent large winners, but many of those winners shrink relative to the market later, while equally weighting treats past performance as less decisive. This is a statistical tendency, not a rule—some firms do sustain long-term outperformance.

Testing and measurement: an exceptionally high or low test score often reverts toward a student’s long-term average on repeat testing unless there was a real change in knowledge.

Conclusion

Regression toward the mean is simple and powerful: after seeing an extreme observation, a less extreme observation is usually more probable than an even more extreme one. It is properly understood as a probability comparison about repeated measurements or independent draws from the same distribution. Confusing this fact with causal explanations (or with the gambler’s fallacy, like I discussed in this blog post) leads to bad reasoning. When evaluating extremes, look for independence and for changes in the underlying process before inferring causes — and remember that sometimes the simplest explanation is just chance pulling outcomes closer to the mean.


Comments

Popular posts from this blog

When Missing Voices and Missing Winners Mislead: Rethinking Retrospective Studies

Evolving Portfolio Weights: A Genetic Algorithm Approach to Mean Reversion