In this note we address the problem of providing a fast, automatic, and coarse processing of the early mapping from emotional facial expression stimuli to the basic continuous dimensions of the core affect representation of emotions, namely valence and arousal. Taking stock of results in affective neuroscience, such mapping is assumed to be the earliest stage of a complex unfolding of processes that eventually entail detailed perception and emotional reaction involving the proper body. Thus, differently from the vast majority of approaches in the field of affective facial expression processing, we assume and design such a feedforward mechanism as a preliminary step to provide a suitable prior to the subsequent core affect dynamics, in which recognition is actually grounded. To this end we conceive and exploit a 3D spatiotemporal deep network as a suitable architecture to instantiate such early component, and experiments on the MAHNOB dataset prove the rationality of this approach.

Taking the Hidden Route: Deep Mapping of Affect via 3D Neural Networks / C. Ceruti, V. Cuculo, A. D’Amelio, G. Grossi, R. Lanzarotti (LECTURE NOTES IN COMPUTER SCIENCE). - In: New Trends in Image Analysis and Processing : ICIAP 2017 / [a cura di] S. Battiato, G.M. Farinella, M. Leo, G. Gallo. - [s.l] : Springer, 2017. - ISBN 9783319707419. - pp. 189-196 (( convegno International Workshops, WBICV, SSPandBE, 3AS, RGBD, NIVAR, IWBAAS, and MADiMa tenutosi a Catania nel 2017 [10.1007/978-3-319-70742-6_18].

Taking the Hidden Route: Deep Mapping of Affect via 3D Neural Networks

C. Ceruti;V. Cuculo;A. D’Amelio;G. Grossi;R. Lanzarotti
2017

Abstract

In this note we address the problem of providing a fast, automatic, and coarse processing of the early mapping from emotional facial expression stimuli to the basic continuous dimensions of the core affect representation of emotions, namely valence and arousal. Taking stock of results in affective neuroscience, such mapping is assumed to be the earliest stage of a complex unfolding of processes that eventually entail detailed perception and emotional reaction involving the proper body. Thus, differently from the vast majority of approaches in the field of affective facial expression processing, we assume and design such a feedforward mechanism as a preliminary step to provide a suitable prior to the subsequent core affect dynamics, in which recognition is actually grounded. To this end we conceive and exploit a 3D spatiotemporal deep network as a suitable architecture to instantiate such early component, and experiments on the MAHNOB dataset prove the rationality of this approach.
Deep neural networks; Continuous affect space
Settore INF/01 - Informatica
Settore ING-INF/05 - Sistemi di Elaborazione delle Informazioni
Book Part (author)
File in questo prodotto:
File Dimensione Formato  
c3d-iciap-w3as.pdf

accesso riservato

Tipologia: Publisher's version/PDF
Dimensione 898.51 kB
Formato Adobe PDF
898.51 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

Caricamento pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/2434/543451
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? 3
social impact