The Sequence Knowledge- Issue 924: The Distilled Models You Need to Know About
TheSequence 1 month ago 16
PrismML released Bonsai 27B in July 2026, a multimodal distilled model with long context designed to run on-device. The binary version is about 3.9 GB, intended to fit in the memory budget of a high-end phone. The release shifts how distillation is framed toward end-to-end low-bit training and quantization, treating model “lineage” and packaged descendants as the meaningful unit rather than the individual checkpoint.