Computer games are a promising tool to support intensive rehabilitation. However, at present, they do not incorporate the supervision provided by a real therapist and do not allow safe and effective use at a patient's home. We show how specifically tailored computational intelligence based techniques allow extending exergames with functionalities that make rehabilitation at home effective and safe. The main function is in monitoring the correctness of motion, which is fundamental in avoiding developing wrong motion patterns, making rehabilitation more harmful than effective. Fuzzy systems enable us to capture the knowledge of the therapist and to provide real-time feedback of the patient's motion quality with a novel informative color coding applied to the patient's avatar. This feedback is complemented with a therapist avatar that, in extreme cases, explains the correct way to carry out the movements required by the exergames. The avatar also welcomes the patient and summarizes the therapy results to him/her. Text to speech and simple animation improve the engagement. Another important element is adaptation. Only the proper level of challenge exercises can be both effective and safe. For this reason exergames can be fully configured by therapists in terms of speed, range of motion, or accuracy. These parameters are then tuned during exercise to the patient's performance through a Bayesian framework that also takes into account input from the therapist. A log of all the interaction data is stored for clinicians to assess and tune the therapy, and to advise patients. All this functionality has been added to a classical game engine that is extended to embody a virtual therapist aimed at supervising the motion, which is the final goal of the exergames for rehabilitation. This approach can be of broad interest in the serious games domain. Preliminary results with patients and therapists suggest that the approach can maintain a proper challenge level while keeping the patient motivated, safe, and supervised.

Intelligent Game Engine for Rehabilitation (IGER) / M. Pirovano, R. Mainetti, G. Baud Bovy, P.L. Lanzi, N.A. Borghese. - In: IEEE TRANSACTIONS ON COMPUTATIONAL INTELLIGENCE AND AI IN GAMES. - ISSN 1943-068X. - 8:1(2016 Mar), pp. 43-55. [10.1109/TCIAIG.2014.2368392]

Intelligent Game Engine for Rehabilitation (IGER)

M. Pirovano
Primo
;
R. Mainetti
Secondo
;
N.A. Borghese
2016

Abstract

Computer games are a promising tool to support intensive rehabilitation. However, at present, they do not incorporate the supervision provided by a real therapist and do not allow safe and effective use at a patient's home. We show how specifically tailored computational intelligence based techniques allow extending exergames with functionalities that make rehabilitation at home effective and safe. The main function is in monitoring the correctness of motion, which is fundamental in avoiding developing wrong motion patterns, making rehabilitation more harmful than effective. Fuzzy systems enable us to capture the knowledge of the therapist and to provide real-time feedback of the patient's motion quality with a novel informative color coding applied to the patient's avatar. This feedback is complemented with a therapist avatar that, in extreme cases, explains the correct way to carry out the movements required by the exergames. The avatar also welcomes the patient and summarizes the therapy results to him/her. Text to speech and simple animation improve the engagement. Another important element is adaptation. Only the proper level of challenge exercises can be both effective and safe. For this reason exergames can be fully configured by therapists in terms of speed, range of motion, or accuracy. These parameters are then tuned during exercise to the patient's performance through a Bayesian framework that also takes into account input from the therapist. A log of all the interaction data is stored for clinicians to assess and tune the therapy, and to advise patients. All this functionality has been added to a classical game engine that is extended to embody a virtual therapist aimed at supervising the motion, which is the final goal of the exergames for rehabilitation. This approach can be of broad interest in the serious games domain. Preliminary results with patients and therapists suggest that the approach can maintain a proper challenge level while keeping the patient motivated, safe, and supervised.
Bayes methods; fuzzy systems; game engine; patient rehabilitation; virtual feedback; virtual therapist; Artificial Intelligence; Software; Control and Systems Engineering; Electrical and Electronic Engineering
Settore INF/01 - Informatica
   Rehabilitative Wayout In Responsive home Environments
   REWIRE
   EUROPEAN COMMISSION
   FP7
   287713
mar-2016
Article (author)
File in questo prodotto:
File Dimensione Formato  
B61_16_TCIAIG-IGER.pdf

accesso riservato

Tipologia: Publisher's version/PDF
Dimensione 15.91 MB
Formato Adobe PDF
15.91 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/387733
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 37
  • ???jsp.display-item.citation.isi??? 30
social impact