Privacy-focused Apple in talks with startup to run more powerful AI models directly on devices
Privacy-focused Apple in talks with startup to run more powerful AI models directly on devices
Publish Date: 2026-07-14 15:30:00
Source Domain: macdailynews.com
Apple’s all-new Siri AI. An even more capable AI assistant with expanded intelligence to be more helpful every day.
Apple is exploring new ways to keep AI processing on users’ devices, prioritizing speed, privacy, and reduced reliance on the cloud. The company is in early discussions with PrismML, a startup developing technology that dramatically compresses large AI models to fit and run efficiently on iPhones.
According to PrismML CEO Babak Hassibi, who spoke to CNBC, Apple and other companies have been evaluating the startup’s models, measuring their speed, energy efficiency, and performance on devices. “They’re really evaluating our technology right now,” Hassibi said of Apple. He described the discussions as very early but noted that “things are progressing nicely.”
Shrinking Massive Models for Everyday Devices
PrismML, a Khosla Ventures-backed spinout from the California Institute of Technology, recently released compressed versions of Alibaba’s open-source Qwen model. The company reduced the model from roughly 54 GB to less than 4 GB, enabling all 27 billion parameters to run on an iPhone 15 or newer.
The compression technique simplifies how internal information is stored—reducing values from 16 bits to just one or three possible values. PrismML claims the compressed models use 10 to 15 times less memory, generate responses six to eight times faster, and consume three to six times less energy than conventional versions.
Hassibi acknowledged a small performance trade-off: “PrismML’s models typically lose a few percentage points of overall performance, with factual recall weakening before skills such as reasoning, math and coding.” Despite this, the company is releasing two compressed versions for free, designed to run on iPhones, MacBooks, and Nvidia-powered PCs.
Boosting Siri and On-Device Capabilities
This development aligns closely with Apple’s ongoing efforts to enhance Siri. Just before PrismML’s release, Apple…
