Spot the Signal

Predicting emerging topics from outliers, played as a click-and-score game.
Grounded in arXiv:2609.29183 β€” "Predicting Emerging Topics from Outliers: A Prospective Study of Weak Signals in Embedding Space" (Zve, Bourgne & Ganascia). arxiv.org/abs/2609.29183. The paper's finding: some documents an embedding-based topic model files as pure noise at publication time later turn out to be the first members of a brand-new topic ("anticipatory outliers"), while most stay noise or drift into existing topics. Using only information available at publication time β€” no hindsight β€” geometric features of each outlier's position in embedding space predict which is which: F1 β‰ˆ0.77 over the full eligible population, rising to >0.90 on high-consensus cases (agreement across multiple embedding models), and 0.76–0.80 under strictly chronological evaluation. Below, the gray dots are today's "noise" β€” a real 2D density heuristic decides, from two slightly different embedding views, which ones are secretly about to cluster into tomorrow's topic. Click your guesses before the reveal.
Existing topics (shaded) are context β€” not clickable. Click the gray outlier dots. Round 1

Play

Click the outlier dots you predict will cluster into tomorrow's emerging topic, then reveal the outcome. Selected: 0

This Round

Your F1
β€”
Model F1
β€”

Running Score

YouF1 β€” Β· 0 rounds
ModelF1 β€”

Legend

Eligible outlier (unresolved)
Your pick
True anticipatory outlier (new topic)
Correct pick
Wrong pick / false alarm
Missed signal

The Heuristic (runs live, in-browser)

Each outlier's k=4 nearest-neighbor density is computed under two slightly different embedding views (view B = view A + Gaussian jitter, standing in for a second embedding model). The 8 densest outliers in each view are candidates; outliers dense in both views form the high-consensus ground truth β€” mirroring the paper's cross-model agreement labeling. The single-view top-8 is the "model prediction" you're scored against.