Attention supports our urge to forage on social cues. Under certain circumstances, we spend the majority of time scrutinising people, markedly their eyes and faces, and spotting persons that are talking. To account for such behaviour, this article develops a computational model for the deployment of gaze within a multimodal landscape, namely a conversational scene. Gaze dynamics is derived in a principled way by reformulating attention deployment as a stochastic foraging problem. Model simulation experiments on a publicly available dataset of eye-tracked subjects are presented. Results show that the simulated scan paths exhibit similar trends of eye movements of human observers watching and listening to conversational clips in a free-viewing condition

On Gaze Deployment to Audio-Visual Cues of Social Interactions / G. Boccignone, V. Cuculo, A. D'Amelio, G. Grossi, R. Lanzarotti. - In: IEEE ACCESS. - ISSN 2169-3536. - 8(2020 Sep 02), pp. 9184838.161630-9184838.161654. [10.1109/ACCESS.2020.3021211]

On Gaze Deployment to Audio-Visual Cues of Social Interactions

G. Boccignone
Primo
;
V. Cuculo
Secondo
;
A. D'Amelio
;
G. Grossi
Penultimo
;
R. Lanzarotti
Ultimo
2020

Abstract

Attention supports our urge to forage on social cues. Under certain circumstances, we spend the majority of time scrutinising people, markedly their eyes and faces, and spotting persons that are talking. To account for such behaviour, this article develops a computational model for the deployment of gaze within a multimodal landscape, namely a conversational scene. Gaze dynamics is derived in a principled way by reformulating attention deployment as a stochastic foraging problem. Model simulation experiments on a publicly available dataset of eye-tracked subjects are presented. Results show that the simulated scan paths exhibit similar trends of eye movements of human observers watching and listening to conversational clips in a free-viewing condition
audio-visual attention; gaze models; multimodal perception; social interaction; computer vision; artificial intelligence; stochastic systems; eye movements; machine learning; deep networks
Settore ING-INF/05 - Sistemi di Elaborazione delle Informazioni
Settore INF/01 - Informatica
Settore M-PSI/01 - Psicologia Generale
2-set-2020
Article (author)
File in questo prodotto:
File Dimensione Formato  
2020_On Gaze Deployment to Audio-Visual Cues of Social Interactions.pdf

accesso aperto

Tipologia: Publisher's version/PDF
Dimensione 3.26 MB
Formato Adobe PDF
3.26 MB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/767390
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 7
  • ???jsp.display-item.citation.isi??? 6
social impact