Apple’s AI toolkit, initially met with mixed reception, is about to deliver on its promise. According to Bloomberg’s Mark Gurman, iOS 18.2, scheduled for release in early December, will bring a significant AI upgrade to iPhones.
This update introduces three key AI enhancements. First, Siri integrates with OpenAI’s ChatGPT, enabling it to handle complex queries seamlessly. Second, Visual Intelligence allows users to extract information from the real world by simply pointing their camera. Currently, it can identify dog breeds or extract text from posters, but with OpenAI integration, its capabilities are expected to expand significantly, mirroring ChatGPT’s multi-modal comprehension.
Siri offloading user query to ChatGPT.
iOS 18.2 also includes the Image Playgrounds app for creative image generation and a custom Genmoji system. But the truly transformative update, according to Gurman, will come with iOS 18.4 in April 2025. This update will allow Siri to access and process user data locally, responding to queries based on on-screen information.
Siri’s Transformation in iOS 18.4
This functionality parallels Google Gemini’s ability to analyze local files and respond contextually. Similar capabilities are also present in Notebook LM, which can process YouTube videos and webpages. With OpenAI integration, Siri in iOS 18.4 will be able to access local files, email data, calendar entries, and even business information from PDFs and spreadsheets to answer user queries.
Imagine asking Siri about travel plans and it automatically pulls the relevant information from your emails. Or, needing a meeting summary and Siri extracts the details from your calendar and related documents.
Visual Intelligence on iPhone.
Perhaps the most practical improvement will be deeper integration with third-party apps, enabling Siri to execute tasks based on voice or text commands. Apple is also planning to integrate other AI models, like Google Gemini, in the future, further expanding Siri’s potential.
The Future of Apple Intelligence
iOS 18.4 is expected to launch around April 2025, coinciding with the rumored release of the next-generation iPhone SE, which is anticipated to feature a redesigned form factor, enhanced processing power, and full support for Apple Intelligence. These updates mark a significant step forward for Apple’s AI capabilities, transforming Siri from a basic virtual assistant into a powerful, integrated intelligence tool. The combination of OpenAI integration, Visual Intelligence, and local data processing promises a more intuitive and useful user experience.