Meta introduces XR Operator to enable AI-driven VR testing

Meta has introduced Meta XR Operator, an experimental OpenXR API layer designed to allow AI coding agents to autonomously interact with, test, and debug virtual reality applications. Available as part of the Meta XR Core SDK v205, the tool functions as a shim that intercepts runtime calls, enabling an AI agent to drive an app much like a human tester would.

By utilizing the Model Context Protocol (MCP), the tool allows AI agents to see and navigate VR environments. Agents can set head positions, move controllers with smooth interpolation, and interact with UI elements such as buttons, toggles, and sliders. The system can also identify spatial entities like walls and furniture. This capability allows developers to use natural language to describe test scenarios, which the agent then executes, providing pass/fail evidence alongside screenshots.

While the tool offers rapid iteration for Unity developers, Meta notes several current limitations. The agent cannot process audio, evaluate complex animations, or utilize individual finger tracking. Additionally, because it operates too slowly for real-time interaction, it is best suited for static, deterministic scenarios. While currently integrated into the Meta XR Core SDK for Unity, a standalone package is available for developers using other OpenXR-backed engines like Godot or Unreal Engine.