Apple Vision Pro gains AI features in visionOS 2.4 update

Apple Vision Pro gets new features
Image credits: Apple | Cropped by GBN
By Shilpa Annie Joseph, Sr. Content Head
  • Follow author on

Apple has launched the visionOS 2.4 update for the Apple Vision Pro, introducing the first set of Apple Intelligence features for the mixed reality (MR) headset.

The company said in a statement that the users can now leverage Writing Tools for summarizing and editing text, Image Playground for reimagining photos, and natural language search in Photos to find the best memories quickly.

Furthermore, the update also bundles a new feature called Spatial Gallery which brings curations by Apple.

visionOS 2.4 Update for the Apple Vision Pro: Features

Apple detailed the new features in Apple Vision Pro part of the visionOS 2.4 update in a newsroom post and the features are available on the headset with the device and Siri language set to US English.

The iPhone maker says Writing Tools is now available on the Apple Vision Pro. It is an AI-powered feature with options for composing, rewriting, and proofreading documents with spelling and grammar checks. It can also summarise the text, create lists and tables, or highlight the key points from the text.

The update brings Image Playground, a standalone app that leverages generative AI to create images based on descriptive prompts. Users can select a reference person from their Photos app for inspiration and can choose from different art styles.

The same app also bundles Genmoji which works similarly but for emojis. Apple says these can be added inline to messages, shared as a sticker, or sent as a Tapback.

Apple Intelligence now lets users search for specific images in the Photos app using natural language queries. Additionally, the ‘Create a Memory Movie’ feature uses AI to generate a storyline with chapters based on themes identified from the photos, arranging them into a movie with a narrative arc tailored to the user’s prompt. Meanwhile, the Smart Reply feature in Mail and Messages offers quick and convenient responses.

Apple noted that visionOS 2.4 also brings support for Priority Messages in Mail, Mail Summaries, Image Wand in Notes, Priority Notifications in the Notification Centre, and Notification Summaries.

Related | Apple plans AI-powered virtual doctor for health app

YOU MAY LIKE