What does Guided Vision in Gemini Live actually do for someone who cannot see the screen?

How the camera becomes a conversational partner

You open Gemini Live, share the rear camera, and the model starts speaking. If the lens points too high, too close, or off to the side, the voice asks you to pan slowly right. It may ask you to tilt downward. Or step back until the scene is clear. That reframing loop runs in real time and feels like a person standing beside you. The feature is called Guided Vision and it arrived on October 1, 2026 for Android 9 and newer devices wherever Gemini Live is available.

Everyday tasks sit at the center of the design

Reading fine print on a nutrition label works. Deciphering a washing-machine dial works. Scanning a dim restaurant menu works the same way: point, listen, ask a follow-up question. Finding a dropped earbud on the floor uses the same flow. Locating the black pepper in a crowded spice cabinet does too. Describing colors, patterns, and shapes lets you check whether a striped shirt matches a pair of trousers. Or identify the color of a specific jacket. Exploring an unfamiliar room layout gives a spoken overview before you move. A table full of objects gets described the same way.

Training data came from tens of thousands of interpreted hours

Google partnered with Aira to collect training data. Aira specialists visually interpreted scenes for tens of thousands of hours. More than 1,000 members of Aira's Trusted Tester network stress-tested the model across daily routines. Aira specialists also worked directly with Google teams as subject-matter experts to establish and evaluate safety guardrails.

The system reflects feedback from blind and low-vision communities across India, Brazil, Singapore, Indonesia, Japan, and more

Conversations run in multiple languages. The same reframing cues and descriptions adapt to the language you speak. Like many accessibility tools, Guided Vision also helps older adults. It helps people with low literacy. It helps anyone trying to read small text in poor light.

Three entry points exist

In the Gemini app, open your profile settings and switch on Use Guided Vision in Live. Then start a Live session and tap to share the camera. Under Android Settings > Accessibility > Vision assistance > Guided Vision, you can bind a floating button. You can bind a two-finger swipe. Or bind pressing both volume keys. TalkBack users bring up the TalkBack menu with a three-finger tap and select Guided Vision directly.

The announcement draws a hard line

Guided Vision is an assistive utility and can make mistakes. It is not a medical device. It is not a mobility aid or white cane replacement. It is not intended for navigation, safe-travel guidance, or obstacle detection. Users should continue relying on established mobility aids and safe-travel practices in physical environments.