TLDRocket
20 October 2026
The biggest throughline today wasn’t model architecture—it was the plumbing. DeepSeek open-sourced DeepInfer, the inference framework behind its production AI services, and backed it with numbers: one cluster serving 155 trillion tokens per day, plus off-peak pricing at $38 per GPU hour. DeepInfer now ships under an Apache 2.0 license on GitHub with support for DeepSeek-V4.1-Flash, while some performance-critical components remain tied to internal infrastructure and non-Nvidia determinism. In other words, the team is sharing the parts that get customers running, and keeping the bits that keep their edges sharp.
Read the full briefing →