Chromesthetic Generative Music Visualiser

The Chromesthetic Generative Music Visualiser is an immersive audiovisual project that seeks to simulate the fascinating phenomenon of chromesthesia for a general user. It aims to provide a window into this unique form of synesthesia, where the experience of hearing music involuntarily evokes a rich internal landscape of colour and texture. By translating musical input into a dynamic and corresponding visual language, the visualiser allows anyone to experience a cohesive and algorithmically generated synesthetic reality.

At the heart of this system is a deep neural network, which acts as the core creative driver between the auditory and visual domains. This network has been trained to analyse a wide array of musical features from any input source—such as harmony, timbre, and rhythm—to generate a complex set of visual parameters that define the project's overall aesthetic and mood. It works in concert with procedural algorithms that are used to render the more direct and precise visual elements.

This process is most apparent in the visualiser's use of colour. When the music modulates to a new key, the neural network interprets this harmonic shift and dynamically alters the entire on-screen colour palette in real-time, reflecting a consistent model of key-to-colour associations.

Furthermore, the network generates the intricate, painterly textures that respond directly to the music's character and dynamics; for example, rendering harmonically rich passages as fractured, crystalline structures. This synthesis of colour and form is displayed across two main components that work in unison: the AI-driven, high-resolution visualiser that creates the ambient background, and the algorithmically-rendered "Note Stream" which provides a clear visualisation of the specific melodic and harmonic lines.

The ultimate goal is to create an experience where the visuals feel intrinsically born from the audio, not merely reactive to it. The Chromesthetic Generative Music Visualiser aims to offer users a unique mode of sensory perception, translating the abstract language of music into a tangible, deeply personal, and ever-evolving work of art.