Michael Mich

https://github.com/ThomasLengeling/KinectPV2

) in processing and detecting all the skeleton joints and positions. What I want to do is to combine sounds and music according to movements of the skeleton joints. (e.g. control pitch or volume of a sound according to the x-position of the left hand). Something like this (https://www.youtube.com/watch?v=uoS0bS6nP1s). As I don't have any experience with music software I would like to ask you which method you recommend in order to implement this. A possible approached that I've found to combine with processing is by using Max7 (https://www.youtube.com/watch?v=FCazZMdSHtk). But I am not sure if Max is the most suitable approach as I am aware that there are many other software (Ableton, virtual midi controllers). In respect to Max7, I am thinking that I could do that by controlling a slider using the skeleton joint position(e.g as the hand moves right the slider value will increase but I don't know how I could do that - assign the position values from processing to a Max's slider).

I am using Kinect with Windows library (https://github.com/ThomasLengeling/KinectPV2) in processing and detecting all the skeleton joints and positions. What I want to do is to combine sounds and music according to movements of the skeleton joints. (e.g. control pitch or volume of a sound according to the x-position of the left hand). Something like this (https://www.youtube.com/watch?v=uoS0bS6nP1s). As I don't have any experience with music software I would like to ask you which method you recommend in order to implement this. A possible approached that I've found to combine with processing is by using Max7 (https://www.youtube.com/watch?v=FCazZMdSHtk). But I am not sure if Max is the most suitable approach as I am aware that there are many other software (Ableton, virtual midi controllers). In respect to Max7, I am thinking that I could do that by controlling a slider using the skeleton joint position(e.g as the hand moves right the slider value will increase but I don't know how I could do that - assign the position values from processing to a Max's slider).

michael M
Mar 14, 13:50 PDT
Hello everyone,
I am using Kinect with Windows library (https://github.com/ThomasLengeling/KinectPV2) in process

max-kinectgesture-music-interaction

If you want to keep using Processing then maybe send some values you are interested in, e.g. vertical wrist joint position, out via OSC (many examples on the web of OSC in Processing). These could be read in most music software, including Max. If you want to learn how to make Max patches then great, you can do interesting stuff with logic and generative audio content etc, just start going through the Max MSP tutorials for an idea of the learning curve required. However, if you just want easy access to control parameters of some music you have composed in Ableton for example that could be a pretty easy workflow. Ableton will allow you to control things like volume, pitch shifting, effect parameters etc with OSC messages. 

On the other hand, you could do everything in Max, including your visuals, and use something like the dp.kinect external to get the kinect data into Max 

. Also there is OSCeleton, NImate to name a couple of others.

If you want to keep using Processing then maybe send some values you are interested in, e.g. vertical wrist joint position, out via OSC  (many examples on the web of OSC in Processing). These could be read in most music software, including Max. If you want to learn how to make Max patches then great, you can do interesting stuff with logic and generative audio content etc, just start going through the Max MSP tutorials for an idea of the learning curve required. However, if you just want easy access to control parameters of some music you have composed in Ableton for example that could be a pretty easy workflow. Ableton will allow you to control things like volume, pitch shifting, effect parameters etc with OSC messages. 

On the other hand, you could do everything in Max, including your visuals, and use something like the dp.kinect external to get the kinect data into Max https://hidale.com/shop/dp-kinect/  . Also there is OSCeleton, NImate to name a couple of others. 

Max-kinect/gesture-music-interaction