AI deepfakes drive rise in extortion and voice cloning scams

The rise of generative AI has facilitated the creation of realistic deepfakes, which are increasingly used for extortion, fraud, and harassment. Cyber threat detection company ESET warns that these tools allow criminals to impersonate individuals through both visual and auditory means, often using audio clips harvested from social media.

In the United States, the TAKE IT DOWN Act has been implemented to penalize the distribution of non-consensual intimate imagery (NCII), requiring online platforms to provide reporting mechanisms and remove such content within 48 hours. Similarly, the United Kingdom’s Data Act and Online Safety Act criminalize the creation of such content with a mandatory 48-hour removal window. The European Union’s AI Act is also expected to introduce prohibitions on systems specifically designed to create non-consensual intimate images.

Beyond visual deepfakes, AI voice cloning is being used in sophisticated scams. A report by Hiya indicates that one in four people in the United States reported receiving a call with a deepfake voice in the last year. Common tactics include virtual kidnapping scams, where criminals use cloned voices to trick family members into believing a loved one has been abducted. Experts suggest using pre-agreed security words to verify identities during suspicious calls.