An experimental analysis is proposed concerning the use of physiological signals, specifically remote Photoplethysmography (rPPG), as a potential means for detecting Deepfakes (DF). The study investigates the effects of different variables, such as video compression and face swap quality, on rPPG information extracted from both original and forged videos. The experiments aim to understand the impact of face forgery procedures on remotely-estimated cardiac information, how this effect interacts with other variables, and how rPPG-based DF detection accuracy is affected by these quantities. Preliminary results suggest that cardiac information in some cases (e.g. uncompressed videos) may have a limited role in discriminating real videos from forged ones, but the effects of other physiological signals cannot be discounted. Surprisingly, heart rate related frequencies appear to deliver a significant contribution to the DF detection task in compressed videos.

On Using rPPG Signals for DeepFake Detection: A Cautionary Note / A. D'Amelio, R. Lanzarotti, S. Patania, G. Grossi, V. Cuculo, A. Valota, G. Boccignone (LECTURE NOTES IN COMPUTER SCIENCE). - In: Image Analysis and Processing – ICIAP 2023 / [a cura di] G.L. Foresti, A. Fusiello, E. Hancock. - Cham : Springer Science and Business Media Deutschland GmbH, 2023. - ISBN 978-3-031-43152-4. - pp. 235-246 (( Intervento presentato al 22. convegno International Conference on Image Analysis and Processing, ICIAP tenutosi a Udine : September 11–15 nel 2023 [10.1007/978-3-031-43153-1_20].

On Using rPPG Signals for DeepFake Detection: A Cautionary Note

A. D'Amelio
Primo
;
R. Lanzarotti
Secondo
;
S. Patania;G. Grossi;V. Cuculo;G. Boccignone
Ultimo
2023

Abstract

An experimental analysis is proposed concerning the use of physiological signals, specifically remote Photoplethysmography (rPPG), as a potential means for detecting Deepfakes (DF). The study investigates the effects of different variables, such as video compression and face swap quality, on rPPG information extracted from both original and forged videos. The experiments aim to understand the impact of face forgery procedures on remotely-estimated cardiac information, how this effect interacts with other variables, and how rPPG-based DF detection accuracy is affected by these quantities. Preliminary results suggest that cardiac information in some cases (e.g. uncompressed videos) may have a limited role in discriminating real videos from forged ones, but the effects of other physiological signals cannot be discounted. Surprisingly, heart rate related frequencies appear to deliver a significant contribution to the DF detection task in compressed videos.
Deepfake detection; Physiological signals; rPPG; Video forensics
Settore INF/01 - Informatica
Settore ING-INF/05 - Sistemi di Elaborazione delle Informazioni
2023
Book Part (author)
File in questo prodotto:
File Dimensione Formato  
2023_CIAP_DeepFake_rPPG_preprint.pdf

accesso aperto

Tipologia: Pre-print (manoscritto inviato all'editore)
Dimensione 704.32 kB
Formato Adobe PDF
704.32 kB Adobe PDF Visualizza/Apri
978-3-031-43153-1-2-1.pdf

accesso riservato

Descrizione: Paper
Tipologia: Publisher's version/PDF
Dimensione 844.74 kB
Formato Adobe PDF
844.74 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/1010370
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 1
social impact