Apple in talks with startup that shrinks AI models to run on an iPhone

TLDR · 1 day ago

Apple is in talks with PrismML, a startup that compresses artificial intelligence models to run on smartphones, after the company publicly released a version of Alibaba's Qwen model optimized for iPhones. PrismML reduced the Qwen model from 54 GB to under 4 GB, enabling it to run on iPhone 15 and newer devices with all 27 billion parameters intact. Running larger AI models directly on iPhones would reduce latency, lower cloud costs, improve privacy, and enable features to work without internet connectivity.