Research on Accessible Digital Musical Instruments (ADMIs) dedicated to users with motor disabilities, facilitated by the introduction of new sensors on the mass market during the last decades, has carved out an important niche within the scenario of new interfaces for musical expression. Among these instruments, Netytar, developed in 2018, is a hands-free ADMI enabling the performance of monophonic melodies, controlled using the gaze (for the selection of the notes) and the breath (for the control of the dynamics), through an eye tracker and an ad-hoc breath sensor. In this article we propose Netychords, a Netytar extension developed to allow a quadriplegic musician to play chords. The instrument is controlled using gaze and head movement. A head tracking paradigm is used to control chord strumming, through a cheap ad-hoc built head tracker. Interaction methods and mappings are discussed, along with a series of experimental chord keys layouts, problems encountered and planned future developments.

Netychords: An Accessible Digital Musical Instrument for Playing Chords using Gaze and Head Movements / N. Davanzo, M. De Filippis, F. Avanzini - In: Proceedings of the 5th International Conference on Computer-Human Interaction Research and Applications / [a cura di] H.Plácido Silva, L. Constantine, A. Holzinger. - [s.l] : SCITEPRESS, 2021. - ISBN 978-989-758-538-8. - pp. 202-209 (( Intervento presentato al 5. convegno International Conference on Computer-Human Interaction Research and Applications nel 2021.

Netychords: An Accessible Digital Musical Instrument for Playing Chords using Gaze and Head Movements

N. Davanzo;F. Avanzini
2021

Abstract

Research on Accessible Digital Musical Instruments (ADMIs) dedicated to users with motor disabilities, facilitated by the introduction of new sensors on the mass market during the last decades, has carved out an important niche within the scenario of new interfaces for musical expression. Among these instruments, Netytar, developed in 2018, is a hands-free ADMI enabling the performance of monophonic melodies, controlled using the gaze (for the selection of the notes) and the breath (for the control of the dynamics), through an eye tracker and an ad-hoc breath sensor. In this article we propose Netychords, a Netytar extension developed to allow a quadriplegic musician to play chords. The instrument is controlled using gaze and head movement. A head tracking paradigm is used to control chord strumming, through a cheap ad-hoc built head tracker. Interaction methods and mappings are discussed, along with a series of experimental chord keys layouts, problems encountered and planned future developments.
Accessible Digital Musical Instrument; Eye Tracking; Head Tracking; Chords
Settore INF/01 - Informatica
https://www.scitepress.org/Papers/2021/106892/106892.pdf
Book Part (author)
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/946463
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 0
social impact