Development of AMIE medical AI system

Researchers have developed AMIE, a multi-agent medical AI system powered by Gemini and Project Astra, designed to conduct real-time video teleconsultations. The system utilizes multimodal capabilities, including audiovisual perception and low-latency dialogue, to perform clinical reasoning and guide patients through physical examinations, such as the pronator drift test.

In studies involving simulated patients and general practitioners, the system matched or exceeded the performance of primary care physicians in several key areas. These include medical history collection, diagnostic accuracy, the relevance of treatment proposals, and communication quality. Simulated patients expressed a preference for these video-based interactions over text-only formats.

While the system demonstrates expert-level clinical reasoning, developers note that human connection and subtle perception remain essential to patient care. Google emphasizes that AMIE is currently a research system rather than a commercial product, and further studies are necessary before any clinical application.