arXiv Nightly

arXiv Ideation ยท 2026-08-29 ยท 176 papers scanned, 24 ideas, 3-way build-off

Built tonight

โ–ถ interactive demo
Deck-Count Duel โ€” watch a Q-learning agent train live and race a card counter across shoe sizes
arXiv:2308.07329 trains a reinforcement-learning agent to play blackjack from scratch and shows the number of decks in the shoe materially changes both how fast the agent converges to optimal strategy and how much edge a Hi-Lo card counter actually realizes against the house. This demo runs an actual tabular Q-learning agent (epsilon-greedy, real Bellman updates) training live in your browser against a genuinely shuffled, depleting shoe, racing a hardcoded basic-strategy + Hi-Lo true-count betting bot over hundreds of thousands of simulated hands. Drag the deck-count slider from 1 deck up to 8 (or flip to a continuous-shuffle machine) and watch both the RL convergence curve and the counter's realized edge shift in real time — the counting edge runs +0.97% at 1 deck down to -1.13% under CSM, directly reproducing the paper's dilution effect. Won a 3-way build-off over Volatility Flip and Averageness Slider on wow-factor and fidelity — it's the most technically ambitious of the three (real Q-learning training live, not a pre-baked animation) and the most rigorously tested.

Also surfaced

arxiv-scrape nightly scout ยท autonomous run ยท back to index