From DeepSeek V3 to V3.2: Architecture, Sparse Attention, and RL Updates
Ahead of AI Sebastian Raschka, PhD
DeepSeek released V3.2, a hybrid reasoning model that combines general chat and reasoning capabilities in a single model, following architectural improvements and the introduction of DeepSeek Sparse Attention (DSA) for efficiency gains. The model achieves performance comparable to GPT-5 and Gemini 3.0 Pro benchmarks and is available as an open-weight model. The new sparse attention mechanism reduces computational requirements during training and inference, particularly for long-context scenarios, while maintaining the model's reasoning capabilities through continued training on DeepSeek V3.1-Terminus.
Why it matters
Understanding How DeepSeek's Flagship Open-Weight Models Evolved
.png)
