The paper presents an architecture for multimodal mood-based annotation systems. The architecture aims at the implementation of interactive multimodal systems to support communities of users in the creation and management of annotations in locative media projects. The annotations are multimodal in that they can be created and accessed through visual and audio interaction. The annotations are mood-based in that they reflect the mood of the user respect to the point of interest s/he is commenting. The paper presents a definition of multimodal mood-based annotation and a description of the architecture, illustrating in particular the interaction process between users and systems through the audio interface. A concrete application of the architecture is presented: an annotative locative media project aimed at supporting tourists in creating annotations related to the Valchiavenna valley in Italy.

Multimodal mood-based annotation / B.R. Barricelli, M. Malcangi, P. Mussio. - In: WSEAS TRANSACTIONS ON INFORMATION SCIENCE AND APPLICATIONS. - ISSN 1790-0832. - 8:5(2011 May), pp. 213-222.

Multimodal mood-based annotation

B.R. Barricelli
Primo
;
M. Malcangi
Secondo
;
P. Mussio
Penultimo
2011

Abstract

The paper presents an architecture for multimodal mood-based annotation systems. The architecture aims at the implementation of interactive multimodal systems to support communities of users in the creation and management of annotations in locative media projects. The annotations are multimodal in that they can be created and accessed through visual and audio interaction. The annotations are mood-based in that they reflect the mood of the user respect to the point of interest s/he is commenting. The paper presents a definition of multimodal mood-based annotation and a description of the architecture, illustrating in particular the interaction process between users and systems through the audio interface. A concrete application of the architecture is presented: an annotative locative media project aimed at supporting tourists in creating annotations related to the Valchiavenna valley in Italy.
Communication ; Multimedia ; Multimodal ; Audio ; Annotation ; Mood ; Speech recognition
Settore INF/01 - Informatica
mag-2011
Article (author)
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/166169
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? ND
social impact