We present a simple, yet general method to detect fake videos displaying human subjects, generated via Deep Learning techniques. The method relies on gauging the complexity of heart rate dynamics as derived from the facial video streams through remote photoplethysmography (rPPG). Features analyzed have a clear semantics as to such physiological behaviour. The approach is thus explainable both in terms of the underlying context model and the entailed computational steps. Most important, when compared to more complex state-of-the-art detection methods, results so far achieved give evidence of its capability to cope with datasets produced by different deep fake models.
DeepFakes Have No Heart: A Simple rPPG-Based Method to Reveal Fake Videos / G. Boccignone, S. Bursic, V. Cuculo, A. D'Amelio, G. Grossi, R. Lanzarotti, S. Patania (LECTURE NOTES IN COMPUTER SCIENCE). - In: Image Analysis and Processing – ICIAP 2022 / [a cura di] S. Sclaroff, C. Distante, M. Leo, G.M. Farinella, F. Tombari. - [s.l] : Springer, 2022. - ISBN 978-3-031-06429-6. - pp. 186-195 (( convegno International Conference on Image Analysis and Processing, ICIAP 2021 tenutosi a Lecce nel 2022 [10.1007/978-3-031-06430-2_16].
DeepFakes Have No Heart: A Simple rPPG-Based Method to Reveal Fake Videos
G. Boccignone;S. Bursic;V. Cuculo;A. D'Amelio
;G. Grossi;R. Lanzarotti;S. Patania
2022
Abstract
We present a simple, yet general method to detect fake videos displaying human subjects, generated via Deep Learning techniques. The method relies on gauging the complexity of heart rate dynamics as derived from the facial video streams through remote photoplethysmography (rPPG). Features analyzed have a clear semantics as to such physiological behaviour. The approach is thus explainable both in terms of the underlying context model and the entailed computational steps. Most important, when compared to more complex state-of-the-art detection methods, results so far achieved give evidence of its capability to cope with datasets produced by different deep fake models.File | Dimensione | Formato | |
---|---|---|---|
ICIAP2021___DeepFake_detection.pdf
accesso aperto
Tipologia:
Post-print, accepted manuscript ecc. (versione accettata dall'editore)
Dimensione
4.32 MB
Formato
Adobe PDF
|
4.32 MB | Adobe PDF | Visualizza/Apri |
Boccignone2022_Chapter_DeepFakesHaveNoHeartASimpleRPP.pdf
solo utenti autorizzati
Tipologia:
Publisher's version/PDF
Dimensione
681.68 kB
Formato
Adobe PDF
|
681.68 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.