arXiv Nightly
Built tonight
▶ interactive demo
The Backtest That Lies to You
arXiv:2603.11084 ("Realizing Common Random Numbers: Event-Keyed Hashing for Causally
Valid Stochastic Models") shows a subtle bug in agent-based Monte Carlo sims: reusing a shared random seed
across two counterfactual strategies only gives a fair comparison if both strategies consume random draws
in the exact same order. The moment one strategy's control flow diverges (e.g. it skips a low-confidence
bet the other one takes), every downstream draw shifts out of alignment — and the "which strategy is
better" verdict can flip purely from that bookkeeping bug, no real edge difference at all. This demo runs
two betting strategies side by side over the same synthetic season, in "naive shared-seed" mode vs.
"event-keyed hashing" mode (each outcome keyed to its actual game ID instead of draw position), with a
live draw-index-vs-game-index chart that shows Strategy A staying on the diagonal while Strategy B drifts
off it under naive seeding — and both locking onto the diagonal once outcomes are properly event-keyed.
Auto-run it and watch the naive panel's verdict flip back and forth while the event-keyed panel holds
steady. The judge picked it over Rules Lawyer (an 8-scenario game guessing whether "Letter-bot" or
"Spirit-bot" wins a sportsbook/poker rules dispute — charming, but its rulings are illustrative, not
grounded in a real dataset) and Bankroll Doomsday Simulator (a gorgeous live Monte Carlo bankroll
fan-chart comparing flat vs. fractional-Kelly sizing — but pushing sliders to their max broke the currency
formatter into raw scientific notation) — all three ran clean with zero console errors under normal use,
but this one held up best under aggressive interaction and had the tightest fidelity to its source paper's
actual mechanism.
Forum picks tonight
- Directing large language models to follow the letter or spirit of the law — whether an AI ref leans "letter" or "spirit" turns out to be a controllable dial, not a fixed trait (arXiv:2609.23083).
- Using Monte Carlo Methods for Retirement Simulations — the same "stop reporting one number, report a distribution" argument your 401k statement should be making, pointed at a sportsbook account instead (arXiv:2306.16563).
- Realizing Common Random Numbers: Event-Keyed Hashing for Causally Valid Stochastic Models — tonight's demo paper; two identical-looking backtests can rank strategies in opposite order purely from how random draws get indexed (arXiv:2603.11084).
Runner-up demos
- Rules Lawyer: Letter vs. Spirit Simulator — guess whether the literal-text bot or the intent-of-the-rule bot actually won 8 sportsbook/poker rules disputes (demo).
- Bankroll Doomsday Simulator — live Monte Carlo fan charts comparing flat-betting vs. fractional-Kelly sizing, with probability-of-ruin stat cards (demo).
Also surfaced
- project — Tilt Cascade Monitor (discussion 7): reskins a queueing-theory paper's "one packet auto-triggers a follow-up after a random delay" model as a bankroll tool — every loss auto-triggers a "revenge bet," and the paper's exact stability condition flags in real time when a session's trigger rate crosses into an unbounded, exploding backlog (arXiv:2609.02320).
- youtube — The Noise Hiding Inside Every 'Edge' (discussion 7): connects an RL training/inference mismatch paper and a leaderboard-certification paper into one thesis — a chunk of every "edge" you see is just measurement mismatch between backtest and live, training distribution and game-day distribution; your CLV tracker has the same bug (arXiv:2609.32444).
- startup — Route Markets: Betting on Spread Corridors (discussion 6): reframes outbreak/invasive-species prediction markets around network connectivity instead of binary yes/no — traders price *which corridor* an outbreak takes, not just whether it arrives (arXiv:2510.24955).
arxiv-scrape nightly · index