The field of medical acoustics is gaining constantly-increasing attention by the scientific community, with the the general goal being the automatic understanding of medical related signals to assist medical personnel in the decision making process. In this direction, this work introduces a framework able to differentiate between normal and abnormal respiratory sounds by learning relationships characterizing pairs of sounds. More specifically, considering the nature of respiratory sounds, we designed a feature set able to capture the coarse and fine structure exhibited such signals by means of multiresolution analysis. Similar/dissimilar relationships are modeled via a suitably-learned Siamese Neural Network encompassing a series of convolutional layers. Interestingly, such a relationship learning framework conveniently solves the existing class imbalance problem as it is trained on pairs of similar/dissimilar audio signals. Importantly, we employed the dataset designed for the IEEE BioCAS 2022 Grand challenge on Respiratory Sound Classification along with a standardized experimental protocol allowing reproducibility and reliable comparison between different approaches. After extensive experiments assessing the proposed framework from diverse points of view, including an ablation study, it is shown that it outperforms existing approaches, while providing explainable predictions via a Q&A scheme allowing interaction with the medical experts.

Explainable Siamese Neural Network for Classifying Pediatric Respiratory Sounds / S. Ntalampiras. - In: IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS. - ISSN 2168-2194. - (2023), pp. 1-8. [Epub ahead of print] [10.1109/JBHI.2023.3299341]

Explainable Siamese Neural Network for Classifying Pediatric Respiratory Sounds

S. Ntalampiras
2023

Abstract

The field of medical acoustics is gaining constantly-increasing attention by the scientific community, with the the general goal being the automatic understanding of medical related signals to assist medical personnel in the decision making process. In this direction, this work introduces a framework able to differentiate between normal and abnormal respiratory sounds by learning relationships characterizing pairs of sounds. More specifically, considering the nature of respiratory sounds, we designed a feature set able to capture the coarse and fine structure exhibited such signals by means of multiresolution analysis. Similar/dissimilar relationships are modeled via a suitably-learned Siamese Neural Network encompassing a series of convolutional layers. Interestingly, such a relationship learning framework conveniently solves the existing class imbalance problem as it is trained on pairs of similar/dissimilar audio signals. Importantly, we employed the dataset designed for the IEEE BioCAS 2022 Grand challenge on Respiratory Sound Classification along with a standardized experimental protocol allowing reproducibility and reliable comparison between different approaches. After extensive experiments assessing the proposed framework from diverse points of view, including an ablation study, it is shown that it outperforms existing approaches, while providing explainable predictions via a Q&A scheme allowing interaction with the medical experts.
medical acoustics; respiratory sound analysiyaudio pattern recognition; siamese neural networks; explainable AI; interpretable AI;
Settore INF/01 - Informatica
2023
27-lug-2023
Article (author)
File in questo prodotto:
File Dimensione Formato  
Explainable_Classification_of_Respiratory_Sounds.pdf

embargo fino al 27/07/2025

Tipologia: Post-print, accepted manuscript ecc. (versione accettata dall'editore)
Dimensione 2.57 MB
Formato Adobe PDF
2.57 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/989628
Citazioni
  • ???jsp.display-item.citation.pmc??? 0
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 0
social impact