[REVISION HISTORY]

Anthropic AI development and security

3 recorded revisions of this situation.

What changed

2026-10-28 05:54 UTC → 2026-10-28 15:47 UTC · added ~~removed~~

Anthropic is conducting research into training AI agents to perform complex negotiations, such as those involving contracts and salaries, by mimicking professional legal standards. The company is reportedly consulting with law firms to analyze how attorneys advocate for client interests and seek equitable outcomes. As autonomous agents are expected to handle increasing commercial and personal disputes, Anthropic is studying interaction norms between models, specifically determining when an agent should request human intervention and how to establish appropriate levels of skepticism to prevent dysfunctional behavior. Experimental data from these studies indicates a strong correlation between an AI model’s capabilities and its negotiation success. In tests involving the exchange of goods via AI proxies, higher-performing models consistently secured better results for their users, exhibiting social dynamics similar to human negotiators. In a separate development regarding the company’s security, the cybersecurity startup Cathedral used AI agents during an authorized testing program to access Anthropic’s internal ~~systems.~~ systems in under 12 hours. The researchers exploited vulnerabilities in third-party administrative and sales software to access data including employee compensation, meeting transcripts, and Slack discussions regarding advanced AI models. Anthropic stated that while some sales, human resources, and IT systems were accessed, core AI infrastructure, including Claude customer conversations, model weights, and source code, remained secure. The company disabled the affected software until vendors provided fixes and reported the incident to federal authorities. While the breach raised national security concerns among government officials regarding the potential for state-sponsored actors to replicate such automated attacks, Anthropic characterized the implications as overstated. Cathedral was founded by former staffers of the Department of Government Efficiency (DOGE), and its co-founder previously served as the Pentagon’s chief data officer.

Versions

Select a version to see what changed compared to the one before it.