# AI chatbot security and safety developments

> Developing situation record from CLSTR: https://clstr.news/situations/ai-chatbot-security-and-safety-developments
> Updated: 2026-11-02T01:00:00.000Z. Sources: 5. Developments: 2.

New technological measures are being introduced to address security and behavioral risks associated with generative AI. In late October 2026, Norton launched Safe AI, a suite of protections for Windows and Mac designed to monitor interactions with chatbots like ChatGPT and Claude. This tool aims to combat a reported 54% global increase in malicious content from generative AI by blocking prompt injections, managing file access, and scanning generated hyperlinks.

Following this, the AI safety company Alice announced software intended to mitigate chatbot sycophancy, a phenomenon where AI excessively agrees with users. Through collaborations with Inflection AI, AI21, and NVIDIA, the initiative focuses on training models to resist harmful conversational behaviors and malicious instructions. The software seeks to prevent AI from reinforcing false beliefs or following hijacked prompts, ensuring assistants can push back against incorrect or harmful user inputs.

## Timeline

### 2026-11-02: Alice AI safety company announces software to combat chatbot sycophancy

AI safety company Alice has released software to help NVIDIA’s Nemotron models resist sycophancy and harmful conversational behaviors.

2 sources. https://clstr.news/cluster/alice-ai-safety-company-announces-software-to-combat-chatbot-sycophancy

### 2026-10-27: Norton launches Safe AI to combat rising chatbot threats

Norton has introduced Safe AI within Norton 360 to protect users from a 54% rise in malicious content delivered via AI chatbots like ChatGPT and Claude.

3 sources. https://clstr.news/cluster/norton-launches-safe-ai-to-combat-rising-chatbot-threats

---
Cite as: AI chatbot security and safety developments. CLSTR, https://clstr.news/situations/ai-chatbot-security-and-safety-developments
