A Web Platform to Investigate the Relationship Between Sounds, Colors and Emotions

This paper presents a novel web platform designed to investigate the relationship between sounds, colors, and emotions, with the overarching goal of enhancing the sensory experience of impaired individuals in visual art museums. Taking advantage of the principles of sensory substitution, the project aims to bridge the gap between auditory and visual perception, allowing individuals with visual or cognitive impairments to engage with visual art through alternative sensory modalities. The platform’s architecture is centered around the delivery of short sound stimuli to participants, who then provide feedback on the associations they perceive between these auditory cues and both colors and emotional dimensions. The collected data will be analyzed to discern patterns and correlations, shedding light on how auditory stimuli can be used to evoke visual and emotional responses. This paper outlines the technical and methodological aspects of the web platform, including its design, development, and implementation. It discusses the selection of sound stimuli and the integration of user-friendly interfaces to ensure a seamless experience for participants. Preliminary results from volunteer tests are briefly presented, highlighting intriguing findings regarding the associations between sounds, colors, and emotions.