[CLSTR]
< Back to situations

Monitor this situation.

[SITUATION] · [QUIET] · [INTERNATIONAL]

2 clusters · 13 sources · 3 days · First seen · Last updated

AI prompt injection fraud in Brazilian judiciary

Overview

The Brazilian Supreme Federal Court (STF) identified a first-of-its-kind attempt at procedural fraud involving ‘prompt injection’ techniques. In a case regarding racial quotas for the Public Ministry of Minas Gerais, a legal petition contained hidden instructions written in tiny, white font intended to manipulate artificial intelligence systems into producing a favorable decision.

The STF’s specialized AI security tool, Maria Shield, detected the malicious commands. Because Minister Cristiano Zanin’s office does not use AI to analyze or draft judicial decisions, the attempt had no practical effect on the case. In response, Minister Zanin ordered formal investigations by the Federal Public Ministry and notified the Brazilian Bar Association (OAB) to evaluate potential ethical infractions. A fine of two minimum wages was also imposed for the violation of procedural loyalty.

Entities

Ministério Público de Minas Gerais · Ministério Público Federal · Supremo Tribunal Federal · Cristiano Zanin · large language models

Timeline

  1. [TECHNOLOGY] 2 sources
    Prompt injection emerges as a major security vulnerability for AI applications

    Prompt injection is a rising AI security threat where malicious instructions hidden in data can override system commands, functioning similarly to traditional SQL injection attacks.

  2. [INTERNATIONAL] 11 sources
    STF identifies first attempt at AI prompt injection fraud in legal petition

    The Brazilian Supreme Court identified a fraud attempt using hidden AI 'prompt injection' commands in a legal petition. Minister Cristiano Zanin ordered investigations into potential criminal and ethical abuses

Sources

brasil247.com · cartacapital.com.br · cbn.globo.com · conexaoto.com.br · conjur.com.br · dev.to · direitoce.com.br · garrastazu.adv.br · gazetadetaguatinga.com.br · itapevinoticias.jor.br · nhbr.com · ouniversodatv.com · ubirataonline.com.br