Voice-Controlled Interface for Digital Musical Instruments

Max is used to analyze voice signal, computing a large set of low-level vocal features, to analyze the instrument parameter-to-sound relationship, computing a set of perceptual timbre descriptors. Vectors and matrices are handled in Max with the FTM extensions. This data is used to compute outside Max the mapping with unsupervised machine learning techniques.

Max is then used to implement part of the mapping in real-time, and to provide the user with an extensive GUI for tuning at runtime mapping algorithm, and it communicate via OSC with the VCI4DMI core routine.

A set of Max For Live devices allow the communication between the VCI4DMI and Ableton Live, which host the instrument (native or plugins), for analysis or real-time control purposes.

Year

2014

Location

Singapore