Motion capture tutorials..Can anyone point me in the right direction...?

Mubase's icon

Hi there. My name is Steve and I am an undergraduate audio systems student. I am currently starting a project involving creating a patch to convert video to audio using jitter and MSP (no MIDI.) I am interested in using motion capture to change sound parameters in either an already existing piece of audio or using MSP to create a basic synthesis model that can be changed by a camera input. Maybe even creating graphical shapes that can be moved by the viewer thereby changing the characteristics of the sound. I have some experience of Max/MSP having created small patches and a MONOSynth using wavetable buffers, filters and an env generator but have no experience of Jitter. i would like to know if anyone reading this can point me in the right direction of a tutorial or let me know where to get started using motion capture to move objects on screen...
Any help would be really appreciated.
Cheers!
Steve.

esnho's icon

Hi, look at this library:
http://jmpelletier.com/cvjit/

maybe blob tracking

Gregory Taylor's icon

If people aren't necessarily forthcoming with tutorials or large patches, it's almost certainly because the thing you're asking about is a large and potentially complex patch.

One thing I'm sure your Max experience to date has suggested to you is that there are a lot of different ways to do many kinds of tasks. Since that's the case, perhaps you might have better success by breaking down the task you see yourself as doing [it's a little vague, at this point] into smaller, bite-size pieces and asking about *them.* In addition, you'll almost certainly have better luck when asking about a specific kind of approach if you either describe a very specific kind of problem, or - even better - if you add a piece of the patch you're working on and invite comment on that.

The last person who commented on your patch has already done that for you - they've isolated a portion of what you described and pointed you at a potential solution. Since it sounds like you're comfortable with the noise-production end of your imagined patch, perhaps it'd be useful to have a look at the tracking tools available to you [you might also consider jit.cyclops, or even roll your own using the jit.scissors object to segment camera input] and then proceed from there.

A discussion about how to proceed would be pretty different if you were using cv.jit objects vs. using jit.cyclops, vs. a Kinect vs. creating a few simple patches in Jitter that respond to input and applying them to an input framer arbitrarily sliced using jit.scissors. The good news is that you can do some research by searching Forum postings on nearly all of those possible futures.

Max Patch
Copy patch and select New From Clipboard in Max.

And - depending on what it is you're interested in in terms of features you want to "watch," it's not necessarily rocket surgery....

Mubase's icon

Hi Guys. Thanks for the advice and the link to the cv.jit library.
I have installed the library and have been playing with the cv.jit.track and cv.jit.blobs objects. Still a bit ocnfused but I did work out how to take co-ordinates from cv.jit.track and have them simply change the frequency of phasor~ and tri~ waves. :)
Very nice library and thanks for your patch Gregory.
I'll come back when my patch starts taking shape for real....
Thanks again,
Steve.
Right now I want to work out how to change the dot in cv.jit.track into a shape that can be moved.....

Tobias Rosenberger's icon

Hi Steve,

there is one guy who uploads his max classes to vimeo, including blob tracking with cv.jit: