Motion capture tutorials..Can anyone point me in the right direction…?
Hi there. My name is Steve and I am an undergraduate audio systems student. I am currently starting a project involving creating a patch to convert video to audio using jitter and MSP (no MIDI.) I am interested in using motion capture to change sound parameters in either an already existing piece of audio or using MSP to create a basic synthesis model that can be changed by a camera input. Maybe even creating graphical shapes that can be moved by the viewer thereby changing the characteristics of the sound. I have some experience of Max/MSP having created small patches and a MONOSynth using wavetable buffers, filters and an env generator but have no experience of Jitter. i would like to know if anyone reading this can point me in the right direction of a tutorial or let me know where to get started using motion capture to move objects on screen…
Any help would be really appreciated.
Hi, look at this library:
maybe blob tracking
If people aren’t necessarily forthcoming with tutorials or large patches, it’s almost certainly because the thing you’re asking about is a large and potentially complex patch.
One thing I’m sure your Max experience to date has suggested to you is that there are a lot of different ways to do many kinds of tasks. Since that’s the case, perhaps you might have better success by breaking down the task you see yourself as doing [it's a little vague, at this point] into smaller, bite-size pieces and asking about *them.* In addition, you’ll almost certainly have better luck when asking about a specific kind of approach if you either describe a very specific kind of problem, or – even better – if you add a piece of the patch you’re working on and invite comment on that.
The last person who commented on your patch has already done that for you – they’ve isolated a portion of what you described and pointed you at a potential solution. Since it sounds like you’re comfortable with the noise-production end of your imagined patch, perhaps it’d be useful to have a look at the tracking tools available to you [you might also consider jit.cyclops, or even roll your own using the jit.scissors object to segment camera input] and then proceed from there.
A discussion about how to proceed would be pretty different if you were using cv.jit objects vs. using jit.cyclops, vs. a Kinect vs. creating a few simple patches in Jitter that respond to input and applying them to an input framer arbitrarily sliced using jit.scissors. The good news is that you can do some research by searching Forum postings on nearly all of those possible futures.
And – depending on what it is you’re interested in in terms of features you want to "watch," it’s not necessarily rocket surgery….
----------begin_max5_patcher---------- 1458.3oc6Zs0biZCE9Y6eEZ7ryr6150itvEQepa6CsO2o8oNcxHiksIKVPA4 bo6r+2qt.XHAB3rFRdHdhsAYwQmy224h3P957YKVmbGOeA3m.+MX1ruNe1Ly P5AlUb9rEGX2EFyxMSaQXxgCbgbwR6uI42IMi+WhTV3W.x8I4bvMr3i7bvGt O4HXSh38RPHKiCXqSNJUSQcTb5dFHbOSH3werTXwQBdXxQgQh3hAi1Xjex5q +DlTNSwwCQhXtznSnSCpje4nvhQSy34JElIiRDWkwCkVqE6hW4tDPv9qfKAv hO.+SwUsMQHErCbyZ+4rHVb4RuMa2Zi7WUsBLY39HwtZR2AgzRTuHpuPTyWD xCVf7n+yr.H0OqG8aymq+X4.ohqijqRuMRrI41EOFrPmAVUh01gj2mxslwhE KUuqz4VLTOhqwPoEFpAHQXCT9LLot7t9UVb3wXlja8dtgmw1wAah1tkmwEgb Pj.7G+1uzBLfeFtLWFxmfLfAFaQH3kk76Bo9cEf79bELwj0wGVNfI.eVgQkn WKXEY5wJT.RGFhQlvPrCbJwp+T4KsOJWljcOHYaQtqSfVNHRgZ0mwgja30kT eIrbd4b97MdcH+fwHySuNeMhMWyk2x4B0vJ7balx1T9haLyRIQIHQvGJf5N8 .JsH9MvyBnzw.PObLVFkGGsgm0RboW4XgJbKR8A2ypavU9D8KSsKhKNvQejO khIpfJTMcL+TZc3SAgUq.obEvAPTfmVtJWKeOWyJfH9XulqP0URKuRH12wEY tRGenaf9HWsvPMux1qEUIO2R44RcHHiEROIYhRUHMkWOUwpDLtTvHGWX.UKN LjDfw5iHtdTORGlne4UR805j4JMZxxZR6AvuBrUTdE1nqR5WaFob1WBShSxJ mgS.UoLKa8n5htEWVrpxi6ob.TSN.paaVhS0xoLbjgl8TLDzfFPEqQerkjKu O1.sjJUPGTK4YWwEr01e64DErMNQ4KzR.f+SF1uWm+oA1QKT71NptwrdWyKy S8xvgO9n9cX6NOyibHUFJSp8JWyD6N4YJyhxCYE32pf9IXa4RWTuEMuvDkfe qhVdT5e9coYfO7tsHvOBd2Vr4SxGA+fNbhzBsRakVIshxnyGkWLjXD6lzPt9 iwFO5zgN3MG5FrAwgZ1Fn81HldG5NIJD7MlpYbiZGkuNYJzaLUaY3dExT32X pl2DrCZkda7X5I5x8URM8i195AWU8WaL54z4.muC.tqCdpJ8MPWaC4vX5XTt uCHT2mNRqABNiKrYtumkCnKdHhsuK1tv3RlXvIIE7yp2epMHp863GeoBcUK+ UGXpH06FJHg7MfjOdBAIIHFD2F538LZx645.8jXBxDHgHN1NdNFXROs41eJ6 ycgg9c2m6C777Z8fshnSR4h1LR5YDEb4uSIiCuGw1WQq8eYoXYxtcws0QZTv YvtntLuHgbHdwmJJ7.m3QtDqRzYI5VJ15MIigiK22bOKciNV922chqM7uxU6 xXqaCXPiaxuyozPQZPnIAnG7E4A9vAYraAgJiKiATVS5QYanF9EqE5kIO8Nq MeYli4AC7fmSsYgzi2DzxSNlEVxgkag.bZo1vykQByiCt9jZLm8Qa1vE0QfC QaRST4QxK2Kf8tfg1TivhtG03LeiafmiiYl90M2MQ457Ha5NQxfMNz.LNZOF 2kScnCPa7mLsQ27lAANnIQcBFn1fmDsAODOGj+YFWf80d6H6+UEE99MePGWP 5UUtDP5wBBlNuMRCtqC.ENc5i2PHX2db+6ff8r6CL.Wc1HPv9Cv.7lV9E0Gd hlV8oW9EOc5iyPvGxzoOCptuyzFOhFR7H7UTAfIL9ZHad.elaTCi8zYnBfkE hJNYDxVggif9Wpxn55OZTzezP1eB94V+xtMdVZ5M7r7BYZTE0c4bssm8dKMm FIrmZj3hL9MQkymNWKsuM++wqAsL2 -----------end_max5_patcher-----------
Hi Guys. Thanks for the advice and the link to the cv.jit library.
I have installed the library and have been playing with the cv.jit.track and cv.jit.blobs objects. Still a bit ocnfused but I did work out how to take co-ordinates from cv.jit.track and have them simply change the frequency of phasor~ and tri~ waves. :)
Very nice library and thanks for your patch Gregory.
I’ll come back when my patch starts taking shape for real….
Right now I want to work out how to change the dot in cv.jit.track into a shape that can be moved…..
there is one guy who uploads his max classes to vimeo, including blob tracking with cv.jit: