NVIDIA and Princeton Introduce ReplaySSM to Accelerate Hybrid AI Model Decoding

NVIDIA and the Dao AI Lab at Princeton University released ReplaySSM, a technique that accelerates decoding in hybrid language models by caching recent inputs rather than storing the full state-space model (SSM) state at every step, according to a paper published October 12, 2026 on arXiv and a blog post by Michelle Horton on the NVIDIA Developer site. The method is already integrated into NVIDIA TensorRT-LLM, vLLM, SGLang and FlashInfer, and runs in production in GLM-5.3-Flash and Kimi-K3 models.

BeCrypto News shows a short excerpt and links to the publisher. The full report belongs to Blockchain.News.