Google develops AI system for real-time video medical teleconsultations

Google Research and Google DeepMind have developed AMIE, an artificial intelligence system designed to conduct real-time video teleconsultations. Built on Gemini and Project Astra using a multi-agent architecture, the system is capable of interpreting visual and auditory signals, guiding virtual physical examinations, and performing real-time diagnostic reasoning.

In a randomized trial involving simulated patients and general practitioners, expert clinicians evaluated the system's performance. AMIE received positive ratings in several critical areas, including medical history collection, diagnostic accuracy, relevance of treatment proposals, and communication quality. Data from simulated patients indicated a preference for the video-based interaction over text-only conversations.

Google emphasizes that AMIE is currently a research system and is not a commercial product intended to replace physicians. Further studies are required before any potential clinical application.