Back to AI updates
GoogleNew features

Guided Vision in Gemini Live: built for accessibility

If you or someone you know is blind or has low vision, Gemini Live's new Guided Vision can describe surroundings, read fine print, or help locate objects just by pointing a phone camera and asking out loud.

Read the original source 3 min read
Official 'Guided Vision' title card reading 'Visual assistance tailored to your needs', with a glowing blue device icon on a dark background.
Google's official hero image for Guided Vision in Gemini Live. ↗

What changed

Gemini Live now offers Guided Vision, a real-time visual assistant on Android for people who are blind or have low vision, as well as older adults or anyone reading fine print in poor lighting. Users share their camera during a Gemini Live session and get spoken descriptions, help locating objects, and verbal cues to reframe the shot. Google states it is an assistive utility that can make mistakes, and is explicitly not a medical device, mobility aid, or white cane replacement, and is not intended for navigation, safe-travel guidance, or obstacle detection.

Why it matters to your work

If you or someone you know is blind or has low vision, Gemini Live's new Guided Vision can describe surroundings, read fine print, or help locate objects just by pointing a phone camera and asking out loud.

When this could help

When you need help reading a label, finding a dropped or misplaced item, checking whether clothes match, or getting an overview of an unfamiliar room or table layout.

Guided Vision shares your phone camera with Gemini Live so it can describe your surroundings aloud, answer follow-up questions, and give spoken cues to help you aim the camera - built with the blind and low-vision community and visual-assistance company Aira.

How to get started

  1. In the Gemini app, open profile settings and turn on 'Use Guided Vision in Live', then open Gemini Live and share your camera.

    Provider guidance ↗
  2. Alternatively, set an Accessibility shortcut: Android Settings > Accessibility > Vision assistance > Guided Vision.

    Provider guidance ↗
  3. If you use TalkBack, open the TalkBack menu with a three-finger tap and select Guided Vision.

    Provider guidance ↗
  4. Keep the Gemini app and Android system software updated.

    Provider guidance ↗

Give AI a clearer brief

Situation
I want to check what's on a product label or dial that's hard to read.
Consultant
Act as a patient visual-description assistant.
Action
Describe what the camera sees in plain language, then read out the specific text or markings I ask about.
Language
Clear, simple spoken-style sentences.
Ask
Ask which detail matters most if the view is cluttered, before describing everything in the frame.

SCALA suggested prompt · Adapt the context and check the result.

Learn the SCALA method →

Build it into your routine

  1. Daily visual-assistance check

    Keep the Guided Vision shortcut set up (via accessibility shortcut or TalkBack) so it's one tap away for everyday tasks like reading mail, checking appliance settings or confirming matching clothes.

What to check

  • Can make mistakes, as with any generative AI tool. Source ↗
  • Not a medical device, mobility aid, or white-cane replacement, and not meant for navigation, safe-travel guidance or obstacle detection - established mobility aids and practices should still be used. Source ↗

Sources & provider guides

Official documentation checked 12 Oct 2026. SCALA prompts and workflows are suggestions, not claims of hands-on testing.

Source & availability

This is a summary of a published provider announcement, with practical context from SCALA’s feed.

Plan, region, workspace and rollout conditions may affect access in Australia. Check the original source for current availability.

blog.google