In the field of 3D audio, the use of Head-Related Transfer Functions (HRTFs) compliant to the subject anatomical traits is crucial to guarantee a proper individual experience. This work proposes an HRTF individualization method based on anthropometric features automatically extracted from 3D head meshes. The method aims at a fully automated process able to estimate individual median plane HRTF starting from a 3D mesh of the subject’s pinna. The method relies on the HUTUBS dataset including 3D meshes, anthropometry and HRTFs. In the first phase, a set of pinna anthropometric parameters is extracted from the 3D meshes converted to range images. A set of landmarks is fitted on the pinna through the Active Shape Model algorithm to outline its shape. Then, the set of pinna anthropometric parameters defined in HUTUBS is automatically extracted exploiting the landmarks. In the second phase, the relationship between pinna anthropometry and HRTFs is modelled. For each elevation angle considered in HUTUBS, a Generalized Regression Neural Network is trained to predict the corresponding HRTF, given the anthropometry. The method is evaluated in both objective and perceptual metrics showing performances comparable to the state of the art.

HRTF Individualization Based on Anthropometric Measurements Extracted from 3D Head Meshes / D. Fantini, F. Avanzini, S. Ntalampiras, G. Presti - In: 2021 Immersive and 3D Audio: from Architecture to Automotive (I3DA)[s.l] : IEEE, 2021. - ISBN 978-1-6654-0998-8. - pp. 1-10 (( convegno International Conference on Immersive and 3D Audio tenutosi a Bologna nel 2021 [10.1109/I3DA48870.2021.9610904].

HRTF Individualization Based on Anthropometric Measurements Extracted from 3D Head Meshes

D. Fantini
Primo
;
F. Avanzini
Secondo
;
S. Ntalampiras
Penultimo
;
G. Presti
Ultimo
2021

Abstract

In the field of 3D audio, the use of Head-Related Transfer Functions (HRTFs) compliant to the subject anatomical traits is crucial to guarantee a proper individual experience. This work proposes an HRTF individualization method based on anthropometric features automatically extracted from 3D head meshes. The method aims at a fully automated process able to estimate individual median plane HRTF starting from a 3D mesh of the subject’s pinna. The method relies on the HUTUBS dataset including 3D meshes, anthropometry and HRTFs. In the first phase, a set of pinna anthropometric parameters is extracted from the 3D meshes converted to range images. A set of landmarks is fitted on the pinna through the Active Shape Model algorithm to outline its shape. Then, the set of pinna anthropometric parameters defined in HUTUBS is automatically extracted exploiting the landmarks. In the second phase, the relationship between pinna anthropometry and HRTFs is modelled. For each elevation angle considered in HUTUBS, a Generalized Regression Neural Network is trained to predict the corresponding HRTF, given the anthropometry. The method is evaluated in both objective and perceptual metrics showing performances comparable to the state of the art.
Settore INF/01 - Informatica
   Transforming auditory-based social interaction and communication in AR/VR (SONICOM)
   SONICOM
   EUROPEAN COMMISSION
   H2020
   101017743
2021
Book Part (author)
File in questo prodotto:
File Dimensione Formato  
IEEE-HRTF_Individualization_Based_on_Anthropometric_Measurements_Extracted_from_3D_Head_Meshes.pdf

accesso aperto

Tipologia: Publisher's version/PDF
Dimensione 398.97 kB
Formato Adobe PDF
398.97 kB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/885903
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? 0
social impact