Active Computing & AI Education & Skills

Deepfake Evidence and Technology for Forensic Content Oversight and Research

Summary

Original abstract (not yet simplified)

AI is transforming law enforcement, offering new tools for policing but also enabling advanced criminal tactics that challenge traditional methods. The global nature of crime, including cyber threats, trafficking, and terrorism, calls for innovative solutions as LEAs face vast data volumes and increasingly sophisticated criminal activities. AI has raised concerns with deepfakes—highly realistic but fake audio, video, or text that...

View original technical description
AI is transforming law enforcement, offering new tools for policing but also enabling advanced criminal tactics that challenge traditional methods. The global nature of crime, including cyber threats, trafficking, and terrorism, calls for innovative solutions as LEAs face vast data volumes and increasingly sophisticated criminal activities. AI has raised concerns with deepfakes—highly realistic but fake audio, video, or text that can depict individuals saying or doing things they never did. Deepfakes pose serious risks, impacting politics, economy, and social trust. Examples include fabricated videos of political figures and voice-cloned audio for financial fraud, often spread through social networks to deceive and defraud on a large scale.Forensic institutes and courts struggle to differentiate authentic evidence from AI fabrications, especially in cases involving national security. Despite promising detection research, existing methods fall short as current models rely on limited, non-diverse datasets and produce results with limited legal admissibility.The DETECTOR initiative aims to address these challenges, supporting LEAs and forensic experts in analyzing altered media. It offers an integrated solution through cross-border collaboration among AI researchers, LEAs, forensic scientists, legal experts, and ethicists. DETECTOR’s goals include: developing specialized tools for detecting media manipulation, creating comprehensive datasets, researching digital evidence exchange across borders, engaging stakeholders, informing policymakers, and training forensic experts in digital media and AI. Through these efforts, DETECTOR seeks to safeguard digital evidence authenticity and enhance forensic capabilities to counter AI-driven media manipulation across Europe

Related Research

Grants with similar aims, by meaning.

Trust in User-generated Evidence: Analysing the Impact of Deepfakes on Accountability Processes for Human Rights Violations (TRUE)
vera.ai: VERification Assisted by Artificial Intelligence
AI-based-technologies for trustworthy solutions against disinformation
AI4TRUST: AI-based technologies for trustworthy solutions against disinformation
Artificial Intelligence and advanced Data Analytics for Law Enforcement Agencies

Original classification

HORIZON

Plain English summaries and category classifications on this site are generated by AI and may not perfectly reflect the original research.