DeepSeek-v4.1-Flash: Pushing the Limits of KV Cache Compression
Hacker News · 29 Oct 2026, 05:00 AEST
DeepSeek-V4.1-Flash introduces a multimodal Mixture-of-Experts model designed to enhance KV cache compression. It significantly reduces the global KV cache footprint while improving performance for long-context computations.
Key facts
- DeepSeek-V4.1-Flash is a multimodal Mixture-of-Experts (MoE) model with 552B backbone parameters and support for contexts of up to one million tokens.
- The model activates 16B parameters per token during decode but only 8B parameters during prefill, substantially improving cost efficiency for agentic workloads.
- Through a dedicated deployment optimization known as SWA Bounded Replay, the model reduces its persistent KV cache footprint to roughly 1/8 of that of DeepSeek-V4-Flash.
Read aloud
DeepSeek-V4.one-Flash introduces a multimodal Mixture-of-Experts model designed to enhance KV cache compression. It significantly reduces the global KV cache footprint while improving performance for long-context computations. DeepSeek-V4.one-Flash is a multimodal Mixture-of-Experts MoE model with 552B backbone parameters and support for contexts of up to one million tokens. The model activates 16B parameters per token during decode but only 8B parameters during prefill, substantially improving cost efficiency for agentic workloads. Through a dedicated deployment optimization known as SWA Bounded Replay, the model reduces its persistent KV cache footprint to roughly one/eight of that of DeepSeek-V4-Flash.
Sources in this cluster
- DeepSeek-v4.1-Flash: Pushing the Limits of KV Cache Compression
Hacker News · 29 Oct 2026, 05:00 AEST