TLDRocket
Sign in

Model Compression

38 summarised stories about Model Compression, each linking back to the original source. Browse all topics →

+ Follow this topic

Friday, 18 September 2026

PrismML Releases Ternary Bonsai 2 27B: A 5.9 GB Apache 2.0 Model Retaining 98.2% of Qwen3.8 27B Performance

MarkTechPost 3 weeks ago 33 ● 4 sources

PrismML released Ternary Bonsai 2 27B, a ternary-weight version of Qwen3.8 27B that supports text and images. The language model is 5.93 GB, compared with 53.80 GB for FP16. It preserves 98.2% of the parent model’s 20-benchmark average but requires PrismML’s llama.cpp fork or its MLX runtime (stock llama.cpp can’t load the GGUF types).

PrismML launches Bonsai 2 27B, a high-intelligence AI model so small it fits on consumer hardware

SiliconANGLE 3 weeks ago 48 ● 4 sources

PrismML launched Bonsai 2 27B, a second-generation ultra-compact multimodal AI model designed to run on PCs and some high-end mobile devices. It reduces a Qwen3.8 27B model from about 56 GB in 16-bit uncompressed form to about 5.9 GB while retaining about 98.2% of capabilities. Model users can now run this AI locally with lower memory, compute, and power needs, with weights released under Apache 2.0.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.