We present a simple, yet general method to detect fake videos displaying human subjects, generated via Deep Learning techniques. The method relies on gauging the complexity of heart rate dynamics as derived from the facial video streams through remote photoplethysmography (rPPG). Features analyzed have a clear semantics as to such physiological behaviour. The approach is thus explainable both in terms of the underlying context model and the entailed computational steps. Most important, when compared to more complex state-of-the-art detection methods, results so far achieved give evidence of its capability to cope with datasets produced by different deep fake models.
DeepFakes Have No Heart: A Simple rPPG-Based Method to Reveal Fake Videos / G. Boccignone, S. Bursic, V. Cuculo, A. D'Amelio, G. Grossi, R. Lanzarotti, S. Patania (LECTURE NOTES IN COMPUTER SCIENCE). - In: Image Analysis and Processing – ICIAP 2022 / [a cura di] S. Sclaroff, C. Distante, M. Leo, G.M. Farinella, F. Tombari. - [s.l] : Springer, 2022. - ISBN 978-3-031-06429-6. - pp. 186-195 (( convegno International Conference on Image Analysis and Processing tenutosi a Lecce nel 2022 [10.1007/978-3-031-06430-2_16].
DeepFakes Have No Heart: A Simple rPPG-Based Method to Reveal Fake Videos
G. BoccignonePrimo
;S. BursicSecondo
;V. Cuculo;A. D'Amelio
;G. Grossi;R. LanzarottiPenultimo
;S. PataniaUltimo
2022
Abstract
We present a simple, yet general method to detect fake videos displaying human subjects, generated via Deep Learning techniques. The method relies on gauging the complexity of heart rate dynamics as derived from the facial video streams through remote photoplethysmography (rPPG). Features analyzed have a clear semantics as to such physiological behaviour. The approach is thus explainable both in terms of the underlying context model and the entailed computational steps. Most important, when compared to more complex state-of-the-art detection methods, results so far achieved give evidence of its capability to cope with datasets produced by different deep fake models.File | Dimensione | Formato | |
---|---|---|---|
ICIAP2021___DeepFake_detection.pdf
accesso aperto
Tipologia:
Post-print, accepted manuscript ecc. (versione accettata dall'editore)
Dimensione
4.32 MB
Formato
Adobe PDF
|
4.32 MB | Adobe PDF | Visualizza/Apri |
Boccignone2022_Chapter_DeepFakesHaveNoHeartASimpleRPP.pdf
accesso aperto
Tipologia:
Publisher's version/PDF
Dimensione
681.68 kB
Formato
Adobe PDF
|
681.68 kB | Adobe PDF | Visualizza/Apri |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.