Apple Exploring Ways to Run Much Larger AI Models Directly on iPhones

New AI startup could shrink server-sized models for use on iPhones

PrismML, a startup that uses mathematical wizardry to shrink the size of large language models, could be used to bring more advanced AI capabilities to iPhones in the future.Apple wants to bring bigger AI models to the iPhoneThe company has already been able to compress the 54GB Qwen 3.6 model to just 4GB. And, importantly, the technology that it uses doesn't impact the model's performance.Apple is already keen to find ways to shrink LLMs that w…

Report: Apple interested in startup that runs giant AI models on iPhone without servers

The Information reports that Apple may be interested in PrismML’s technology. The firm is focused on shrinking AI models that...

Apple Exploring Ways to Run Much Larger AI Models Directly on iPhones

Apple has held meetings with PrismML about ways it could use the startup's technology to run much larger AI models directly on iPhones, according to The Information. The report said PrismML has managed to shrink down Alibaba's open-source large language model Qwen 3.6 to run entirely on an iPhone 17 Pro. The model has 27 billion parameters, which is larger than Apple's on-device AFM 3 Core Advanced model with 20 billion parameters.

Apple Explores Larger On-Device AI Models with PrismML

Apple is in talks with PrismML about running 27-billion-parameter language models directly on iPhones, potentially reducing reliance on cloud compute Read more at Apple Explores Larger On-Device AI Models on iPhone with PrismML