What Does 65% Even Mean?

A model says a team has a 65% chance to win. Is that a long-run frequency, or a one-time belief? Turns out: both — and here's the picture that makes it click.

Grounded in "A Unifying Perspective on Probabilities as Model Predictions" (arXiv:2609.09855). The paper argues the Bayesian reading of a predicted probability (a single-event credence) and the frequentist reading (a long-run win rate across repeated trials) are two zoom levels on the same well-calibrated model — not rival theories. The three panels below let you drive each zoom level yourself, then show the thing that reconciles them: a calibration curve built entirely out of one-off events that were each experienced exactly once.

1. Frequentist view Zoomed out — repeated trials

Set a "true" win probability p, then replay the same bet thousands of times. No single replay matters — watch the empirical win rate crawl toward p as the Law of Large Numbers does its thing, live, in your browser.

65%
20
0
Replays
—
Empirical win rate
—
|rate − p|

2. Bayesian view Zoomed in — one event, no do-overs

This game happens once. There is no "long run" to average over — only your current state of belief given the evidence in front of you. Drag the news sliders and watch your credence (and how tightly you hold it) update live.

Riverside Comets vs Lakeshore Hawks
Game 7, win-or-go-home. Tips off in a few hours. This exact matchup, this exact night, never repeats.
0
0
0
58%
current credence Comets win
⚠ n = 1. This number will never be "tested" by repetition — only this single outcome happens.

3. Calibration view Where both views reconcile

Here's the trick: pool together hundreds of different one-off games, each with its own stated probability, each played exactly once (just like panel 2). No single game repeats — but if you bin games by their stated probability and check how often the predicted side actually won in each bin, a well-calibrated model traces the diagonal. Frequency emerges from the aggregate even though no individual event was ever itself repeated. That's the reconciliation the paper is making precise.

0%
Well calibrated — predicted probabilities match reality.
1000
—
Brier score
—
Bins plotted
—
Games pooled