Towards improving the performance in various music information processing tasks, recent studies exploit different modalities able to capture diverse aspects of music. Such modalities include audio recordings, symbolic music scores, mid-level representations, motion and gestural data, video recordings, editorial or cultural tags, lyrics and album cover arts. This paper critically reviews the various approaches adopted in Music Information Processing and Retrieval, and highlights how multimodal algorithms can help Music Computing applications. First, we categorize the related literature based on the application they address. Subsequently, we analyze existing information fusion approaches, and we conclude with the set of challenges that Music Information Retrieval and Sound and Music Computing research communities should focus in the next years.

Multimodal Music Information Processing and Retrieval: Survey and Future Challenges / F. Simonetta, S. Ntalampiras, F. Avanzini - In: 2019 International Workshop on Multilayer Music Representation and Processing (MMRP)[s.l] : IEEE, 2019 Mar. - ISBN 9781728116495. - pp. 10-18 (( convegno International Workshop on Multilayer Music Representation and Processing tenutosi a Milano nel 2019.

Multimodal Music Information Processing and Retrieval: Survey and Future Challenges

F. Simonetta;S. Ntalampiras;F. Avanzini
2019

Abstract

Towards improving the performance in various music information processing tasks, recent studies exploit different modalities able to capture diverse aspects of music. Such modalities include audio recordings, symbolic music scores, mid-level representations, motion and gestural data, video recordings, editorial or cultural tags, lyrics and album cover arts. This paper critically reviews the various approaches adopted in Music Information Processing and Retrieval, and highlights how multimodal algorithms can help Music Computing applications. First, we categorize the related literature based on the application they address. Subsequently, we analyze existing information fusion approaches, and we conclude with the set of challenges that Music Information Retrieval and Sound and Music Computing research communities should focus in the next years.
Multimodal music processing, music information retrieval, music description systems, information fusion
Settore INF/01 - Informatica
mar-2019
Book Part (author)
File in questo prodotto:
File Dimensione Formato  
43 Multimodal_collaborative_music_information_processing_and_retrieval__survey_and_future_challenges.pdf

accesso riservato

Tipologia: Post-print, accepted manuscript ecc. (versione accettata dall'editore)
Dimensione 1.99 MB
Formato Adobe PDF
1.99 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
1902.05347.pdf

accesso aperto

Tipologia: Pre-print (manoscritto inviato all'editore)
Dimensione 1.99 MB
Formato Adobe PDF
1.99 MB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/633063
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 43
  • ???jsp.display-item.citation.isi??? 30
social impact