PrismML's Bonsai AI Model Can Run Locally on iPhone and May Benefit Apple
On July 14, PrismML released the Bonsai 27B artificial intelligence (AI) model that can run locally on an Apple iPhone 17 Pro. The open-weight model is compressed to fit within a phone's memory while retaining about 90% of its original performance. This development aligns with Apple’s hardware design, which includes neural accelerators in the A19 and A19 Pro chips aimed at enhancing AI capabilities. Apple has been focusing on improving local device AI execution but has faced challenges internally, such as delays and underperformance from Siri. Meanwhile, PrismML's CEO mentioned early discussions between the company and Apple about this technology. The rise of free open-weight models like Bonsai could shift consumer expectations away from paid cloud-based services. Apple’s business model relies on hardware sales rather than AI subscription revenue. As local AI becomes more capable, it may drive demand for higher-capacity devices but also increase the cost of goods sold due to memory requirements.
Tickers: $AAPL
Topics: Apple silicon artificial intelligence local ai models