An experimental analysis is proposed concerning the use of physiological signals, specifically remote Photoplethysmography (rPPG), as a potential means for detecting Deepfakes (DF). The study investigates the effects of different variables, such as video compression and face swap quality, on rPPG information extracted from both original and forged videos. The experiments aim to understand the impact of face forgery procedures on remotely-estimated cardiac information, how this effect interacts with other variables, and how rPPG-based DF detection accuracy is affected by these quantities. Preliminary results suggest that cardiac information in some cases (e.g. uncompressed videos) may have a limited role in discriminating real videos from forged ones, but the effects of other physiological signals cannot be discounted. Surprisingly, heart rate related frequencies appear to deliver a significant contribution to the DF detection task in compressed videos.
On Using rPPG Signals for DeepFake Detection: A Cautionary Note / A. D'Amelio, R. Lanzarotti, S. Patania, G. Grossi, V. Cuculo, A. Valota, G. Boccignone (LECTURE NOTES IN COMPUTER SCIENCE). - In: Image Analysis and Processing – ICIAP 2023 / [a cura di] G.L. Foresti, A. Fusiello, E. Hancock. - Cham : Springer Science and Business Media Deutschland GmbH, 2023. - ISBN 978-3-031-43152-4. - pp. 235-246 (( Intervento presentato al 22. convegno International Conference on Image Analysis and Processing, ICIAP tenutosi a Udine : September 11–15 nel 2023 [10.1007/978-3-031-43153-1_20].
On Using rPPG Signals for DeepFake Detection: A Cautionary Note
A. D'Amelio
Primo
;R. LanzarottiSecondo
;S. Patania;G. Grossi;V. Cuculo;G. BoccignoneUltimo
2023
Abstract
An experimental analysis is proposed concerning the use of physiological signals, specifically remote Photoplethysmography (rPPG), as a potential means for detecting Deepfakes (DF). The study investigates the effects of different variables, such as video compression and face swap quality, on rPPG information extracted from both original and forged videos. The experiments aim to understand the impact of face forgery procedures on remotely-estimated cardiac information, how this effect interacts with other variables, and how rPPG-based DF detection accuracy is affected by these quantities. Preliminary results suggest that cardiac information in some cases (e.g. uncompressed videos) may have a limited role in discriminating real videos from forged ones, but the effects of other physiological signals cannot be discounted. Surprisingly, heart rate related frequencies appear to deliver a significant contribution to the DF detection task in compressed videos.File | Dimensione | Formato | |
---|---|---|---|
2023_CIAP_DeepFake_rPPG_preprint.pdf
accesso aperto
Tipologia:
Pre-print (manoscritto inviato all'editore)
Dimensione
704.32 kB
Formato
Adobe PDF
|
704.32 kB | Adobe PDF | Visualizza/Apri |
978-3-031-43153-1-2-1.pdf
accesso riservato
Descrizione: Paper
Tipologia:
Publisher's version/PDF
Dimensione
844.74 kB
Formato
Adobe PDF
|
844.74 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.