Google expands AI and augmented reality for navigation and accessibility

Google is expanding its use of augmented reality and artificial intelligence to enhance navigation and accessibility. Through Google Maps, the Live View feature utilizes a Visual Positioning System (VPS) to overlay digital arrows, street names, and markers onto the real-world environment via a smartphone camera. This technology combines GPS data with inertial sensors, such as gyroscopes and accelerometers, to ensure digital signals remain aligned with the physical surroundings as the user moves.

Additionally, Google has introduced Guided Vision, an AI-driven tool developed in collaboration with the blind and low-vision community. Integrated with Gemini Live, this feature allows users to share their camera feed to receive real-time spoken descriptions of their surroundings. The tool can read small text on product labels, identify everyday objects, and provide auditory guidance on camera positioning. Guided Vision is available on compatible Android devices and is integrated into Google TalkBack.