Stability-Weighted Decoding for Diffusion Language Models
Under review at ICLR 2027.
Overview
An information-theoretic connection between temporal token instability and masked-context dependency motivates stability-aware decoding. On LLaDA-8B, mean accuracy increases from 25.63% to 41.08% across four benchmarks while average forward evaluations decrease by 22.7%.