< Back to all clusters
[TECHNOLOGY] · United Kingdom · 7 sources

started · updated

Enterprise AI Governance Risks Rise as Survey Shows Growing Incidents

A survey of 687 IT and security leaders by Jamf found that 72.9% of organizations have already deployed AI, but deeper integration makes incidents 40% more likely. More than one‑in‑five respondents (22%) reported AI‑related cost or security problems, and 59.7% view such incidents as a near‑term risk. The findings highlight the need for robust AI governance as AI spreads into developer tools, productivity apps, and autonomous agents.

Industry experts warn that AI hallucinations – confident but inaccurate outputs – pose serious threats to customer experience. A high‑profile case at a major law firm showed AI‑generated errors slipping through human review, illustrating that human oversight cannot scale to monitor AI outputs in real‑time. In CX settings, hallucinations can erode trust, damage reputation, and create compliance liabilities.

Gartner’s analysts identify emerging trends such as sovereign AI, decision‑intelligence platforms, and AI governance tools that provide centralized oversight, risk management, and auditability. They predict that AI‑driven decisions will become five times more trusted and 80% faster by 2029 if governed properly.

Adobe’s senior director of customer experience emphasizes a “trust threshold” for AI deployment, deterministic AI foundations for accurate personalization, and well‑designed escalation paths to human agents. Meanwhile, Priya Prabhu outlines how regulated enterprises can build production‑grade generative‑AI platforms that embed security, compliance, and observability from the start, using cloud‑native architectures and retrieval‑augmented generation.