Generative Adversarial Networks (GAN) are being increasingly used to perform face aging due to their capabilities of automatically generating highly-realistic synthetic images by using an adversarial model often based on Convolutional Neural Networks (CNN). However, GANs currently represent black box models since it is not known how the CNNs store and process the information learned from data. In this paper, we propose the first method that deals with explaining GANs, by introducing a novel qualitative and quantitative analysis of the inner structure of the model. Similarly to analyzing the common genes in two DNA sequences, we analyze the common filters in two CNNs. We show that the GANs for face aging partially share their parameters with GANs trained for heterogeneous applications and that the aging transformation can be learned using general purpose image databases and a fine-tuning step. Results on public databases confirm the validity of our approach, also enabling future studies on similar models.

Towards explainable face aging with Generative Adversarial Networks / A. Genovese, V. Piuri, F. Scotti (PROCEEDINGS - INTERNATIONAL CONFERENCE ON IMAGE PROCESSING). - In: 2019 IEEE International Conference on Image Processing (ICIP)[s.l] : IEEE, 2019. - ISBN 9781538662496. - pp. 3806-3810 (( Intervento presentato al 26. convegno International Conference on Image Processing tenutosi a Taipei nel 2019.

Towards explainable face aging with Generative Adversarial Networks

A. Genovese;V. Piuri;F. Scotti
2019

Abstract

Generative Adversarial Networks (GAN) are being increasingly used to perform face aging due to their capabilities of automatically generating highly-realistic synthetic images by using an adversarial model often based on Convolutional Neural Networks (CNN). However, GANs currently represent black box models since it is not known how the CNNs store and process the information learned from data. In this paper, we propose the first method that deals with explaining GANs, by introducing a novel qualitative and quantitative analysis of the inner structure of the model. Similarly to analyzing the common genes in two DNA sequences, we analyze the common filters in two CNNs. We show that the GANs for face aging partially share their parameters with GANs trained for heterogeneous applications and that the aging transformation can be learned using general purpose image databases and a fine-tuning step. Results on public databases confirm the validity of our approach, also enabling future studies on similar models.
No
English
GAN; Face aging; CNN; Deep Learning
Settore INF/01 - Informatica
Settore ING-INF/05 - Sistemi di Elaborazione delle Informazioni
Intervento a convegno
Comitato scientifico
Ricerca applicata
Pubblicazione scientifica
   COntactlesS Multibiometric mObile System in the wild: COSMOS
   MINISTERO DELL'ISTRUZIONE E DEL MERITO
   201548C5NT_004
2019 IEEE International Conference on Image Processing (ICIP)
IEEE
2019
3806
3810
5
9781538662496
Volume a diffusione internazionale
International Conference on Image Processing
Taipei
2019
26
Convegno internazionale
Intervento inviato
Aderisco
A. Genovese, V. Piuri, F. Scotti
Book Part (author)
partially_open
273
Towards explainable face aging with Generative Adversarial Networks / A. Genovese, V. Piuri, F. Scotti (PROCEEDINGS - INTERNATIONAL CONFERENCE ON IMAGE PROCESSING). - In: 2019 IEEE International Conference on Image Processing (ICIP)[s.l] : IEEE, 2019. - ISBN 9781538662496. - pp. 3806-3810 (( Intervento presentato al 26. convegno International Conference on Image Processing tenutosi a Taipei nel 2019.
info:eu-repo/semantics/bookPart
3
Prodotti della ricerca::03 - Contributo in volume
File in questo prodotto:
File Dimensione Formato  
icip19.pdf

accesso aperto

Tipologia: Post-print, accepted manuscript ecc. (versione accettata dall'editore)
Dimensione 1.1 MB
Formato Adobe PDF
1.1 MB Adobe PDF Visualizza/Apri
08803616.pdf

accesso riservato

Tipologia: Publisher's version/PDF
Dimensione 1.15 MB
Formato Adobe PDF
1.15 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/641465
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 21
  • ???jsp.display-item.citation.isi??? 17
social impact