Hey Siri, you’re now the framework for Apple’s smart glasses


No, Apple has not announced Smart glasses in WWDC. or AirPods camera. Or a Foldable phone. This developer conference was, as many expected, devoid of new products. But while this was the show All about the new Siri And other AI capabilities, which in many ways is exactly what is needed to power smart glasses and more in the coming years.

I said this In the preview story Before WWDC, and now that the news is out, I feel like it’s even healthier.

Watch this: What we know about the new Siri, which is coming to all your Apple products

The ongoing, more aware, visually-enabled AI framework that now runs across all of Apple’s devices seems like the first stage of a system that Apple’s Glasses, AirPods, or anything else could rely on to feel like extensions of Apple’s product ecosystem. It may turn out to be more private and Maybe less creepy Replicate the technology that dead and Google You’re also moving forward.

I’ve already been trying out a little Siri AI via Apple’s early developer beta, and it really gets me thinking.

Meta Ray-Ban glasses stand in front of the green glass sculpture garden

Without displays, Apple’s first-generation Glasses will need the new, supercharged Siri to keep track of things in the built-in app. (Meta Ray-Bans are shown here.)

Scott Stein/CNET

An AI application to connect everything

Every pair of smart glasses in the world now runs on a single AI platform. Meta uses AI. Google uses Gemini. Now, it’s clear that Apple’s glasses expected in 2027 will use Siri AI. The glasses use artificial intelligence to learn about the world through cameras and audio, and can link notifications and apps when possible.

The Meta glasses are hampered by the relatively small number of phone connections, making its AI feel disconnected from most things a person might do on apps elsewhere. There are only a few apps that link together at the moment: Spotify, Apple Music, Strava, Garmin, and the core Meta apps. Meta started in Open Application Development They have their own viewing glasses, but a lot of the apps really work like browser extensions.

Apple's Justin Tite demonstrates on an iPhone how Siri AI can be used to plan a World Cup party menu.

Having Siri in an app now means that devices without screens, such as glasses, may have better continuity with other devices they are connected to, such as phones. He also remembers previous conversations.

Apple/CNET screenshot

Google You will take things further By linking with Gemini, and also acting as an extension for Android. The eyewear line coming this fall should be a huge leap forward in making glasses that feel like an extension of your phone, even offering apps and notifications in display-enabled models.

It looks like Apple now has the chops to get to Glasses, in the form of Siri, based on everything I’ve seen. The new version of Siri can keep a history of conversations, work across devices, and even take actions to link to apps or type in apps like Notes or Calendar.

One area where Apple can outperform everyone else is the deep contextual themes through Apple’s operating systems and the content we hold on them. I don’t know how well the new Siri will work yet, but Apple’s new re-indexing of all its devices with Spotlight search is designed to fuel Siri’s awareness of everything. App permissions to link to Siri, which are already built into the “App Intent Framework” that Apple has on its devices, can allow Siri to link to other apps seamlessly. And if Siri can do it, glasses will be able to do it too.

The Apple iPhone monitored books, using Siri to analyze them via camera using artificial intelligence

Siri’s visual intelligence is getting more advanced this year, and smart glasses will need it.

Scott Stein/CNET

Siri can see things better now

Apple also added a visually perceptive layer that was missing most of the time. Siri can see things in the room when the Camera app is open on your iPhone or recognize what’s on your phone’s screen. In Vision Pro, camera awareness is faster in VisionOS 27. Asking Siri what’s there and simply looking at it triggers Siri’s awareness of what you see on the app or in the room with you.

Apple doesn’t have continuous, “live” visual awareness for Siri yet. Both Meta and Google have modes directly on their glasses, and the Samsung Galaxy XR can constantly see and analyze videos or video games, or be a constant companion while actively doing something. But this could come. What you’ll get from Siri AI starting in the fall is a big jump toward a key missing piece.

Siri appears as an orb in a VisionOS 27 living room screenshot, with floating screens for Siri chat

Siri lives as an orb in VisionOS 27 now, and can see your room and your open apps.

apple

Vision Pro’s advancements are a mark

See Apple Pro The headphone is gaining Some subtle upgrades With Siri AI and VisionOS 27, each looks like a piece that could be part of glasses.

Siri has its most distinctive appearance on VisionOS, with a glowing ball companion that can appear to be in the room with you. When Apple tries to make augmented reality glasses that can shrink the size of the Vision Pro and connect it to a phone – similar to the idea behind Google and Xreal Hala Projectcoming later this year, which uses a phone-like processing tablet — perhaps that Siri model could come. It’s also an always-aware, all-seeing AI that could move into those glasses, starting with what’s seen in VisionOS now.

Apple also added a little trick for notifications to expand when you look at them in the new VisionOS, something that makes me wonder if Apple is trying to imagine how notifications on an everyday pair of glasses could expand and contract quickly to avoid distraction. Apple Glass is unlikely to have eye-tracking anytime soon, but perhaps those notifications will shrink and expand with hand gestures or air taps via the Apple Watch, which now has another gestural command In WatchOS 27 To add to their slowly growing collection.

Meta Ray-Ban smart glasses atop a stack of colorful cards showcasing Apple products

Apple Glasses could be the next major piece in the connected device puzzle.

Scott Stein/CNET

The Vision Pro is a feature-rich, powerful, and expensive mixed reality PC, something that glasses won’t be able to come close to for a long time.

But Siri has all of these pieces across all of Apple’s multi-format devices, and Apple is committed to making everything work on its own. This sounds exactly like the formula for a pair of smart glasses — or an AI necklace, or camera-equipped AirPods — to feel like a smart companion.

The Vision Pro is taking the first steps, but I expect glasses to take part of the journey to where Apple goes next. We won’t know anything now, and we may not hear anything again until sometime in 2027. But perhaps Apple’s WWDC infrastructure conference in 2026 is the next major step to getting there.



Leave a Reply

Your email address will not be published. Required fields are marked *