DeepSeek-V4.1 Flash: Pushing the Limits of KV Cache Compression
GitHub Pages 3 weeks ago 3
DeepSeek-V4.1 Flash’s technical report lays out architectural and precision techniques to push KV cache compression to reduce long-context compute and storage bottlenecks. It reports reaching nearly 420 tokens/s with the release. The result is a CED + CSA2 design that supports up to 1 million tokens while cutting KV cache footprint further (including about 4x more compression) and improving serving efficiency.