RokVid Patch

If you are new to Max, I'd recommend taking a look through the Jitter tutorials to get a sense of how Max deals with video in general. That way, you'll see how to get a live feed from a camera and movie files into your patch for processing. You'll also see how to create different kinds of video effects.

Once you are able to create some effects you like, you are in a good position to think about how audio can control those effects. My approach is: whenever I create a knob, slider, or number box that I like playing around with, I ask myself, "Is there some data from the world that can play around with this knob/slider/number box for me?" If you are interested in audio, you can then take a look at the MSP tutorial to see how you can build LFOs or use live audio to control your video effect.

In the case of RokVid, I use several LFO shapes (built with cycle~, rect~, saw~, and rand~) and several audio features (built with peakamp~, zerox~, and filters).

For video effects, I use entirely shaders created using jit.gl.pix. If you are not familiar with that, jit.gl.pix is part of the Gen add-on to Max. It lets you create objects that process pixels on your computer GPU using OpenGL, which is an efficient way to perform video processing. I create the effects from scratch, and I often use feedback loops because I like that kind of thing.

If you want to use the Kinect, I suggest you look through the forums to see how people are getting it connected to Max. I use a Mac and have been able to get Kinect data using jit.openni -- however, there are changes up ahead for the Kinect with the end of the OpenNI library so this may change in the near future. You are on a PC, so you will have different options.

Regardless, once you get the Kinect data, it will again be up to you how to map it to turn those knobs/sliders/number boxes, if you want to approach it that way. I hope this was helpful!