The field of medical acoustics is gaining constantly-increasing attention by the scientific community, with the the general goal being the automatic understanding of medical related signals to assist medical personnel in the decision making process. In this direction, this work introduces a framework able to differentiate between normal and abnormal respiratory sounds by learning relationships characterizing pairs of sounds. More specifically, considering the nature of respiratory sounds, we designed a feature set able to capture the coarse and fine structure exhibited such signals by means of multiresolution analysis. Similar/dissimilar relationships are modeled via a suitably-learned Siamese Neural Network encompassing a series of convolutional layers. Interestingly, such a relationship learning framework conveniently solves the existing class imbalance problem as it is trained on pairs of similar/dissimilar audio signals. Importantly, we employed the dataset designed for the IEEE BioCAS 2022 Grand challenge on Respiratory Sound Classification along with a standardized experimental protocol allowing reproducibility and reliable comparison between different approaches. After extensive experiments assessing the proposed framework from diverse points of view, including an ablation study, it is shown that it outperforms existing approaches, while providing explainable predictions via a Q&A scheme allowing interaction with the medical experts.
Explainable Siamese Neural Network for Classifying Pediatric Respiratory Sounds / S. Ntalampiras. - In: IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS. - ISSN 2168-2194. - (2023), pp. 1-8. [Epub ahead of print] [10.1109/JBHI.2023.3299341]
Explainable Siamese Neural Network for Classifying Pediatric Respiratory Sounds
S. Ntalampiras
2023
Abstract
The field of medical acoustics is gaining constantly-increasing attention by the scientific community, with the the general goal being the automatic understanding of medical related signals to assist medical personnel in the decision making process. In this direction, this work introduces a framework able to differentiate between normal and abnormal respiratory sounds by learning relationships characterizing pairs of sounds. More specifically, considering the nature of respiratory sounds, we designed a feature set able to capture the coarse and fine structure exhibited such signals by means of multiresolution analysis. Similar/dissimilar relationships are modeled via a suitably-learned Siamese Neural Network encompassing a series of convolutional layers. Interestingly, such a relationship learning framework conveniently solves the existing class imbalance problem as it is trained on pairs of similar/dissimilar audio signals. Importantly, we employed the dataset designed for the IEEE BioCAS 2022 Grand challenge on Respiratory Sound Classification along with a standardized experimental protocol allowing reproducibility and reliable comparison between different approaches. After extensive experiments assessing the proposed framework from diverse points of view, including an ablation study, it is shown that it outperforms existing approaches, while providing explainable predictions via a Q&A scheme allowing interaction with the medical experts.File | Dimensione | Formato | |
---|---|---|---|
Explainable_Classification_of_Respiratory_Sounds.pdf
embargo fino al 27/07/2025
Tipologia:
Post-print, accepted manuscript ecc. (versione accettata dall'editore)
Dimensione
2.57 MB
Formato
Adobe PDF
|
2.57 MB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.