Skip to content

Synesthesia Simulator

An innovative application that simulates the neurological phenomenon of synesthesia by converting colors into musical notes in real-time. Using computer vision to analyze webcam input, the system maps color properties to musical characteristics - hue determines the note, brightness controls the octave, and saturation selects the instrument timbre (piano, violin, or trumpet). The grid-based analysis system allows users to explore how different colors in their environment translate into unique soundscapes. This project combines OpenCV for visual processing with Pygame for audio synthesis, offering an engaging way to experience the intersection of perception, AI, and creative expression.

Led by: Charitra Jain
Department: Tech

Technologies Used

OpenCVNumPyPygameScipy