Amazon launches CloudWatch Omni for AI agent observability

Amazon has introduced CloudWatch Omni, an AI-first observability platform designed to unify the monitoring of traditional applications, cloud infrastructure, and autonomous AI agents within a single environment.

Unlike traditional monitoring that focuses on metrics like latency and CPU usage, CloudWatch Omni addresses the non-deterministic nature of AI agents. It evaluates agent performance based on quality scores, including correctness, coherence, retrieval accuracy, and tool selection. This allows teams to identify issues where an agent might technically succeed but produce incorrect or inefficient results.

The platform supports various agent frameworks, such as LangChain, CrewAI, and the OpenAI SDK, and integrates with Amazon Bedrock AgentCore. It utilizes open standards like OpenTelemetry and OpenInference to ensure existing telemetry can be integrated without complex reconfigurations.

Developers can access CloudWatch Omni through a standalone web interface with enterprise single sign-on or via IDE extensions for VS Code and Kiro, reducing the need to navigate the standard AWS Management Console.