Google launches Guided Vision AI for Gemini Live on Android

Guided Vision Gemini Live visual assistance accessibility features AI computer vision

Google has launched Guided Vision, a new AI-powered feature within Gemini Live for compatible Android devices. Designed primarily to assist blind and low-vision users, the tool provides real-time audio descriptions of a user's surroundings through their smartphone camera.

Beyond simple object identification, Guided Vision can read small text, such as food labels or expiration dates, and describe complex environments. A key technical feature is its ability to provide conversational feedback to help users frame their shots; the AI can suggest tilting the phone, moving closer, or stepping back to better capture a specific object.

Developed in collaboration with the visual assistance company Aira, the feature underwent extensive testing with members of the blind and low-vision community. While it offers significant utility for daily tasks like reading menus or identifying household items, Google explicitly warns that it is not a replacement for mobility aids like white canes and should not be used for navigation or obstacle detection.

Entities

Aira · Android · Gemini · Gemini Live · Google · Guided Vision

Claims

What the coverage asserts, and how many sources carry each claim.

[● 2 SOURCES] Users can ask follow-up questions about objects in view, such as reading expiration dates or small text. www.it-boltwise.de · www.newsbytesapp.com
[● 3 SOURCES] Google has launched Guided Vision, a new feature in Gemini Live for compatible Android devices. www.it-boltwise.de · www.techritual.com · www.newsbytesapp.com
[● 3 SOURCES] The feature provides real-time audio descriptions of a user's surroundings via their phone camera. www.it-boltwise.de · www.techritual.com · www.newsbytesapp.com
[● 2 SOURCES] The tool is compatible with Android 9 and above and integrates with TalkBack. www.techritual.com · www.newsbytesapp.com
[● 2 SOURCES] Guided Vision is intended for people who are blind or have low vision. www.techritual.com · www.newsbytesapp.com
[○ 1 SOURCE] Over 1,000 members of Aira's Trusted Tester network participated in refining the model. www.techritual.com
[○ 1 SOURCE] Google collaborated with Aira, using tens of thousands of hours of visual interpretation training data. www.techritual.com
[● 2 SOURCES] The feature is not intended to replace navigation, obstacle detection, or mobility aids. www.it-boltwise.de · www.newsbytesapp.com