Apple Vision Pro’s vision of the world with AI in VisionOS 27


Apple Vision Pro The devices, which were last updated in the fall with an M5 chip, are getting new software upgrades with the latest version of VisionOS announced in WWDC. One of the most important is visual intelligence, camera-aware AI, finally. It’s exactly the kind of thing Apple produces Expected smart glasseslikely to arrive next year, you will need.

VisionOS 27 can now be previewed in developer beta, and there are a few small updates that look set to improve how the headset works this year.

However, vision-focused AI tools are what interest me most. They’re part of the new Apple Siri-focused AI updates Advertise on This year’s WWDC conference. Asking Siri will allow you to see things on the apps you have open on VisionOS, but Siri will also be able to recognize things that are in the room with you as well.

This is the same type of camera-aware AI that Google and Samsung already have Samsung Galaxy XR The headset, which arrived last fall. But in the case of VisionOS 27, Apple isn’t doing any kind of live mode for Siri that can see what’s happening continuously like Gemini Live. Instead, Siri just captures visuals of what’s in front of your eyes at that moment by tracking your gaze.

Siri appears as an orb in a VisionOS 27 living room screenshot, with floating screens for Siri chat

Siri lives as an orb in VisionOS 27 now.

apple

VisionOS 27 has some other interesting additions, though they’re unlikely to be enough to attract newcomers. Personal panoramas can be turned into immersive 3D wallpapers. There’s also a new way to preview 3D objects from Mac apps within Vision Pro, a way to extend apps virtually as part of the creative workflow.

However, Apple has yet to develop any new core apps for the Vision Pro, nor has it made any progress in enabling the Apple Watch, iPhone, or iPad to function as connected Vision accessories, which is something I was hoping would happen. Apple still relies on Macs as the best PC companions to its $3,500 headphones.

While many people reported that The life of Vision Pro ends In the face of A Switch to smart glasses In the next few years, it’s clear that Vision Pro devices can do things that no glasses can dream of anytime soon. But I’ve been waiting for Apple’s Spatial Computer to make the most of its processing power, sensors, and higher price, and these additions are welcome, and these updates are mostly incremental, with the exception of Siri.

I’ll be trying out the developer beta soon, and will write up some thoughts on the subject.



Leave a Reply

Your email address will not be published. Required fields are marked *