Gemini will use Volvo’s exterior cameras to interpret parking signs

Gemini gains the power of sight and Navigation. Today at the I/O conferenceGoogle and Volvo announced that the AI-powered assistant will be able to access external cameras The upcoming EX60 SUV To help explain and interpret the surrounding areas to vehicle owners. The upgrade is made possible by Volvo’s use of Google’s embedded Android Automotive as the vehicle’s operating system.

Google assumes the first use case will be asking Gemini to translate hard-to-understand parking signs, though the company clearly sees other future applications as possible as well. Google envisions a camera-equipped Gemini that remembers road signs, interprets trail markings, or even answers questions about a nearby landmark or restaurant. The company says Gemini will be able to tell car owners how long they can park in a particular location, whether they need certain permits, and other restrictions.

“In the future, Gemini will make your driving more rewarding by allowing you to learn more about your surroundings while on the road,” Patrick Brady, vice president of Android Automotive at Google, said in a statement.

This feature is not supported by Google’s Gemini alone; It also builds on the processing power built into the EX60 thanks to the Nvidia Drive AGX Orin compute platform, as well as over-the-air software capabilities.

It seems that interpreting a parking sign could be legitimately useful – as long as it’s accurate. Obviously, testing will determine if the system works as well as Google claims. I live in the New York City area, and parking signs are very difficult to decipher. But you can also imagine a scenario in which Gemini incorrectly interprets a parking sign, resulting in an expensive ticket, or worse, an impounded car. Google needs to make sure it uses this feature, otherwise car owners will simply disable it.

Thanks to the power of sight, Google also says Maps will be more adept at providing navigation directions. Volvo will be among the first automakers to receive this award The new immersive navigation feature in Google Mapswhere the 3D track is displayed with better graphics to more closely resemble the real world. By accessing outdoor cameras, for example, Google Maps will provide more conversational directions that take into account nearby landmarks, such as “Go through this light and turn next left at the library.”