Google adds Guided Vision to Gemini Live for Android

Google has rolled out Guided Vision in Gemini Live on compatible Android devices, a feature that uses AI to provide real-time spoken descriptions of whatever a phone camera points at.

The feature can read small text, describe surroundings, locate or identify items and explain their details. Google says it is intended to assist people who are blind, have low vision or need help in specific situations. It is similar to Apple's VoiceOver Live Recognition, which Apple added to iPhone and Vision Pro.

Guided Vision is available in the Gemini app and in Google TalkBack. Users running Android 9 or later can assign an accessibility shortcut for the feature in Settings.

Users can ask follow-up questions about what the camera sees, for example requesting that Gemini read a product expiration date. Google says if the object is not in frame, Gemini can provide voice guidance to help the user position the camera.

When Guided Vision is active in Gemini Live, Gemini provides spoken framing prompts if the camera is too high, too close or slightly tilted. Google says prompts can include instructions such as rotate the camera slowly to the right, tilt it down or step back to obtain a clear visual context.

Google warns that Guided Vision should not be relied on for navigation, safe travel guidance or obstacle detection and must not replace a cane or other mobility aids.