Nightly Arxiv Build · Diffusion LM Interpretability

Lock-In Visualizer

Diffusion language models denoise an answer over many steps. Sometimes the answer stabilizes early and is right. Sometimes it stabilizes early and is permanently wrong — "stable-but-wrong lock-in." The paper's finding: surface confidence cannot tell these apart. Only the hidden-state trajectory can. Watch the run, then guess which one you're looking at.

Grounded in: LOCKR — Hidden-State Trajectory-Guided Planner for Detecting and Repairing Stable-but-Wrong Lock-In in Diffusion Language Models · arXiv:2609.27220
How to play / how to read the trajectory
Each round simulates one toy "denoising" run choosing between answers A / B / C. The left panel plots the model's internal (hidden-state) trajectory in a 2D representation space — a toy stand-in for what LOCKR actually tracks. The right panel shows only what a naive detector sees: surface confidence and answer stability. Per the paper, those two readouts look almost identical whether the lock-in is correct or wrong — that's the whole trap.
  • Searching phase (blue trail) — candidates are still being weighed, position wanders between basins.
  • Locked phase (amber trail) — the argmax has stabilized. Watch closely here.
  • The tell: a genuine correct convergence goes essentially motionless after locking. A wrong lock-in keeps a small persistent tremor / orbit around its basin — the representation never fully settles, even though the displayed answer and confidence stop changing.
Play a run, rewatch it if you like, then guess Real convergence or Wrong lock-in before revealing the truth — and see how you stack up against a naive confidence-only detector and the LOCKR trajectory detector.

Hidden-State Trajectory A · B · C

idle
step 0 / 0
searching locked phase true answer (on reveal) wrongly-locked answer (on reveal)

Surface Signals what a naive detector sees

Confidence
—
Answer / Stability
?
stable for 0 steps
Per LOCKR's finding: confidence, entropy, margin, and answer-stability curves look statistically indistinguishable between correct and wrong lock-ins. Don't trust this panel alone.

Your Call

Based on the trajectory shape (not the numbers above) — is this a real convergence, or a stable-but-wrong lock-in?

Reveal

Scoreboard 0 rounds

You
—
Naive Conf.
—
LOCKR
—
The naive detector always trusts high confidence — watch its accuracy converge to roughly a coin flip as you play more rounds.