Introduction: This study presents MiEmo, a multi-modal digital platform designed to improve emotion recognition in children with Autism Spectrum Condition (ASC). The platform integrates serious games with music and color as feedback mechanisms to strengthen emotion understanding in addition to traditional visual interventions such as pictures and videos. The study aims to assess the usability and potential effectiveness of MiEmo in supporting therapy for children with medium- and high-functioning ASC. Methods: A pilot usability study was conducted in two rehabilitation centers involving 19 children, 8 with me- dium and 11 with high functioning ASC. Participants engaged with six training activities, or exergames, on the MiEmo platform that implemented multi-modal feedback (music pieces and colored animations associated to the emotion). The System Usability Scale (SUS) and qualitative feedback from therapists were used to evaluate the platform’s usability. Results: The average SUS scores were 86.88 for children with medium-functioning ASC and 96.75 for those with high-functioning ASC, indicating positive usability. Therapists noted that while the platform was well-received, further updates are needed for better adaptation to medium-functioning children. Multi-modal feedback, particularly music and color, was found to enhance emotion recognition, with children responding well to the integration of these sensory cues. Conclusion: The study demonstrates that MiEmo has significant potential as a tool for socio-emotional training, particularly for high-functioning children. However, limitations such as the small sample size, short intervention duration, and lack of a control group suggest that future studies with larger participant groups are necessary to validate these findings and assess long-term effects.

MiEmo: A multi-modal platform on emotion recognition for children with autism spectrum condition / E. Chitti, R. Actis-Grosso, P. Ricciardelli, B. Olivari, C. Carenzi, M. Tedoldi, N. Alberto Borghese. - In: COMPUTERS IN HUMAN BEHAVIOR REPORTS. - ISSN 2451-9588. - 17:(2025 Mar), pp. 100549.1-100549.17. [10.1016/j.chbr.2024.100549]

MiEmo: A multi-modal platform on emotion recognition for children with autism spectrum condition

E. Chitti
Primo
;
N. Alberto Borghese
Ultimo
2025

Abstract

Introduction: This study presents MiEmo, a multi-modal digital platform designed to improve emotion recognition in children with Autism Spectrum Condition (ASC). The platform integrates serious games with music and color as feedback mechanisms to strengthen emotion understanding in addition to traditional visual interventions such as pictures and videos. The study aims to assess the usability and potential effectiveness of MiEmo in supporting therapy for children with medium- and high-functioning ASC. Methods: A pilot usability study was conducted in two rehabilitation centers involving 19 children, 8 with me- dium and 11 with high functioning ASC. Participants engaged with six training activities, or exergames, on the MiEmo platform that implemented multi-modal feedback (music pieces and colored animations associated to the emotion). The System Usability Scale (SUS) and qualitative feedback from therapists were used to evaluate the platform’s usability. Results: The average SUS scores were 86.88 for children with medium-functioning ASC and 96.75 for those with high-functioning ASC, indicating positive usability. Therapists noted that while the platform was well-received, further updates are needed for better adaptation to medium-functioning children. Multi-modal feedback, particularly music and color, was found to enhance emotion recognition, with children responding well to the integration of these sensory cues. Conclusion: The study demonstrates that MiEmo has significant potential as a tool for socio-emotional training, particularly for high-functioning children. However, limitations such as the small sample size, short intervention duration, and lack of a control group suggest that future studies with larger participant groups are necessary to validate these findings and assess long-term effects.
ASC; Autism intervention; Emotion recognition; Serious game; Exergame; Social skills; Multi-modal feedback
Settore INFO-01/A - Informatica
Settore PSIC-01/A - Psicologia generale
   Action Interaction between Humanoid Robots and Children with Autism Spectrum Disorders (ASD) within a social context (AIRCA)
   MINISTERO DELL'UNIVERSITA' E DELLA RICERCA
   2022JJJF37_001

   ESSENCE: Empathic platform to personally monitor, Stimulate, enrich, and aSsist Elders aNd Children in their Environment
   ESSENCE
   EUROPEAN COMMISSION
   H2020
   101016112
mar-2025
11-dic-2024
https://www.sciencedirect.com/science/article/pii/S2451958824001829
Article (author)
File in questo prodotto:
File Dimensione Formato  
1-s2.0-S2451958824001829-main.pdf

accesso aperto

Descrizione: Article
Tipologia: Publisher's version/PDF
Dimensione 6.8 MB
Formato Adobe PDF
6.8 MB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/1123518
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact