PrismML Releases Bonsai 27B: 1-bit and Ternary Builds of Qwen3.6-27B That Run on Laptops and Phones
MarkTechPost 1 day ago
PrismML released Bonsai 27B, a quantized version of Qwen3.6-27B using 1-bit and ternary weight compression. The ternary variant achieves 5.9GB model size while retaining 94.6% of FP16 baseline performance, and the 1-bit variant reaches 3.9GB with 89.5% retention. These models enable running 27B-class quality inference on laptops and phones with practical memory constraints and improved throughput on resource-limited devices.