Design, Implementation, and Early Experimentation of a Music Tangible User Interface for Elderly People Rehabilitation

This article proposes an innovative approach for cognitive and motor rehabilitation of elderly individuals that combines tangible user interfaces, digital technologies, and musical expression. After reviewing the current literature on age-related impairments and the use of tangible user interfaces in rehabilitation, we introduce a specific MIDI controller called Kibo that employs geometric fiducials called tangibles. Thanks to Bluetooth connectivity and the adoption of the Web MIDI API, this device communicates with a specially-designed web framework that includes three games to facilitate the development or recovery of cognitive and motor abilities. The feedback obtained in an early experimentation phase from domain experts and a focus group underlined some strengths and weaknesses, thus driving the first revision of the interface and the gameplay. This work will describe the design and implementation of the early prototype and will shed light on the future evolution of the web platform. From the tests conducted so far, this solution based on a musical controller equipped with tangibles exhibits the potential to enhance the effectiveness and enjoyment of rehabilitation programs for elderly individuals.