Mimi, which stands for multimodal interaction for musical improvisation, is a system for human-machine improvisation. Mimi was created by Alexandre François using his Software Architecture for Immersipresence. Visit the Mimi project webpage to find out more.
The concert video with the composer-improviser's annotations, posted September, 2010.
In Mimi, the computer learns from the human musician, creates a factor oracle from the music input, and recombines the material to generate improvisations like the music it 'hears'. The visualizations show the music stream from the computer and from the human, the music material Mimi learns, and how the system recombines the material.
The human musician determines when Mimi learns, when it starts/stops improvising, the loudness of playback, and the recombination rate. The annotations in this video provided by Isaac shows this decision process, and reveals the improviser's thought process as the performance unfolds.
