Apple is bringing its AI prowess to the Vision Pro with the upcoming visionOS 2.4 update, slated for release in April. This update introduces several key AI features, previously available on Macs and iOS devices, tailored for the headset’s unique interface. These additions hint at the potential for a more integrated AI experience across Apple’s ecosystem, including the much-anticipated cross-app AI-powered Siri.
AI-Powered Features Enhance Vision Pro Experience
The visionOS 2.4 beta offers AI functionalities similar to their Mac counterparts, but with UI adjustments for easier prompt input without traditional keyboard and mouse. Users gain access to ChatGPT-like functions for various tasks, including composing and proofreading text directly within the Vision Pro environment.
Genmoji, Image Playground, and “Create a Memory”
The update also introduces Genmoji for personalized emojis in Messages, an Image Playground for generating stylized cartoon versions of friends and pets, and a “Create a Memory” feature within the Photos app. This last feature utilizes AI to create custom slideshows from user photos and videos based on text or voice prompts, offering a novel way to curate and relive memories.
New Vision Pro App for iOS and Spatial Gallery
Beyond AI, visionOS 2.4 enhances the Vision Pro’s integration within the Apple ecosystem. A new Vision Pro app for iOS allows users to remotely manage their headset, including creating watch lists and downloading apps. The update also features a new Spatial Gallery app on the Vision Pro, consolidating spatial photos and videos captured with the headset or compatible devices like the iPhone 15 Pro and iPhone 16 models.
Streamlined Guest User Experience
A significant improvement is the streamlined guest user setup. Owners can now easily grant access to specific apps for guests directly from their iPhone or iPad, eliminating the previous requirement of pre-loading user profiles. They can even stream the guest’s experience to their mobile device via AirPlay, offering a similar experience to Apple’s in-store demos.
The Future of AI on Vision Pro
While the arrival of AI on the Vision Pro was expected, given the M2 chip’s capabilities and Apple’s commitment to AI integration across its M-series devices, the initial implementation focuses on adapting existing features. The real potential lies in future updates, particularly the promised “Visual Intelligence” features, which could revolutionize how users interact with their environment through the headset. The potential integration with a more powerful, cross-app Siri also holds promise for a more intuitive and proactive user experience. While these new features enhance the Vision Pro’s current capabilities, the expectation remains for more transformative functionalities that leverage the headset’s unique strengths beyond its existing use cases as a large-screen display.
