This paper surveys the uses of non-speech voice as an interaction modality within sonic applications. Three main contexts of use have been identified: sound retrieval, sound synthesis and control, and sound design. An overview of different choices and techniques regarding the style of interaction, the selection of vocal features and their mapping to sound features or controls is here displayed. A comprehensive collection of examples instantiates the use of non-speech voice in actual tools for sonic interaction. It is pointed out that while voice-based techniques are already being used proficiently in sound retrieval and sound synthesis, their use in sound design is still at an exploratory phase. An example of creation of a voice-driven sound design tool is here illustrated

Non-speech voice for sonic interaction: a catalogue / A. Del Piccolo, D. Rocchesso. - In: JOURNAL ON MULTIMODAL USER INTERFACES. - ISSN 1783-7677. - 11:1(2017), pp. 39-55. [10.1007/s12193-016-0227-6]

Non-speech voice for sonic interaction: a catalogue

D. Rocchesso
Ultimo
2017

Abstract

This paper surveys the uses of non-speech voice as an interaction modality within sonic applications. Three main contexts of use have been identified: sound retrieval, sound synthesis and control, and sound design. An overview of different choices and techniques regarding the style of interaction, the selection of vocal features and their mapping to sound features or controls is here displayed. A comprehensive collection of examples instantiates the use of non-speech voice in actual tools for sonic interaction. It is pointed out that while voice-based techniques are already being used proficiently in sound retrieval and sound synthesis, their use in sound design is still at an exploratory phase. An example of creation of a voice-driven sound design tool is here illustrated
Information retrieval; Sonic interaction; Sound design; Sound synthesis; Voice; Signal Processing; Human-Computer Interaction
Settore INFO-01/A - Informatica
2017
http://www.springer.com/computer/user+interfaces/journal/12193
Article (author)
File in questo prodotto:
File Dimensione Formato  
art:10.1007/s12193-016-0227-6.pdf

accesso aperto

Tipologia: Publisher's version/PDF
Dimensione 778.44 kB
Formato Adobe PDF
778.44 kB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/1123710
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? 1
  • OpenAlex ND
social impact