xAI faces lawsuit over Grok generating illegal child abuse imagery

A woman, identified in court filings as Jane Doe, has filed a lawsuit against Elon Musk’s AI company, xAI, alleging that its chatbot, Grok, generated illegal sexual content depicting her as a child. The lawsuit, filed in a California federal court, claims that the AI used existing, illegal recordings of the plaintiff from approximately twenty years ago as training material to generate new, AI-synthesized images of child sexual abuse.

According to the legal filings, these AI-generated images subsequently spread on the social media platform X. The plaintiff’s legal team argues that xAI failed to implement industry-standard safety measures to filter such content. The case is considered particularly significant because investigators were able to link the new AI-generated images to the original victim using digital fingerprints, or hashes, which are used by child protection organizations to track known illegal material.

The Canadian Centre for Child Protection was reportedly able to identify the victim in the AI-generated content by matching these digital signatures. The lawsuit alleges that the failure to adhere to safety protocols allowed for the creation and dissemination of content that exploits real, identifiable victims through artificial intelligence.