Tencent Open-Sources AngelSpec: A Unified Training Framework for MTP and Block-Parallel Speculative Decoding on Hy3 Models
MarkTechPost 1 month ago 34
Tencent released AngelSpec, an open-source training framework for speculative-decoding draft models that uses different architectures optimized for different workloads rather than a single universal drafter. The framework includes MTP drafting for conversation (achieving 66.4% acceptance) and DFly block-diffusion drafting for code and math (reaching 4.79 mean accepted length on Hy3-A21B versus 3.69 for prior DFlash). This heterogeneity-aware approach delivers 1.98–2.40× speedup over standard autoregressive decoding across various concurrency levels.