This paper explores the use of a physics-based sound model of continuous contact for auditory display in interactive settings. An audio-visual interactive display is developed in which the sound model is controlled by the user's gestures. The display is used to investigate to what extent audition can substitute for haptic feedback in conveying perception of inertial properties of a manipulated object. In a first experiment the audio-visual display is controlled through a standard pointing device (a marble mouse, or trackball). A second experiment uses a tangible object and a computer vision system that tracks the object motion. Early results suggest that the perception of effort is a cross-modal phenomenon in which auditory feedback plays a relevant role.
Friction sounds for sensory substitution / F. Avanzini, D. Rocchesso, S. Serafin - In: Proc. Int. Conf. Auditory Display (ICAD04)[s.l] : ICAD, 2004. - ISBN 1741080487. - pp. 1-8 (( Intervento presentato al 10. convegno Int. Conf. Auditory Display tenutosi a Sydney nel 2004.
Friction sounds for sensory substitution
F. Avanzini;D. Rocchesso;
2004
Abstract
This paper explores the use of a physics-based sound model of continuous contact for auditory display in interactive settings. An audio-visual interactive display is developed in which the sound model is controlled by the user's gestures. The display is used to investigate to what extent audition can substitute for haptic feedback in conveying perception of inertial properties of a manipulated object. In a first experiment the audio-visual display is controlled through a standard pointing device (a marble mouse, or trackball). A second experiment uses a tangible object and a computer vision system that tracks the object motion. Early results suggest that the perception of effort is a cross-modal phenomenon in which auditory feedback plays a relevant role.File | Dimensione | Formato | |
---|---|---|---|
avanzini_icad04.pdf
accesso riservato
Tipologia:
Post-print, accepted manuscript ecc. (versione accettata dall'editore)
Dimensione
341.25 kB
Formato
Adobe PDF
|
341.25 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.