Alise Ibort

I am working on an interactive video that requires that I motion track a person's movements with a webcam. The data from the webcam will then be routed into Jitter to play a movie clip. Specifically I am trying to match a person's gesture ie: wave, point, to a video of a person performing the same gesture. Does anybody have a sample patch or some starting tips on creating a patch for this?

Hello,
I am working on an interactive video that requires that I motion track a person's movements with a webcam. The data from the webcam will then be routed into Jitter to play a movie clip. Specifically I am trying to match a person's gesture ie: wave, point, to a video of a person performing the same gesture. Does anybody have a sample patch or some starting tips on creating a patch for this?

motion-tracking-2

Quote: Alise Ibort wrote on Sun, 11 February 2007 08:32

----------------------------------------------------

> I am working on an interactive video that requires that I motion track a person's movements with a webcam. The data from the webcam will then be routed into Jitter to play a movie clip. Specifically I am trying to match a person's gesture ie: wave, point, to a video of a person performing the same gesture. Does anybody have a sample patch or some starting tips on creating a patch for this?

check out the cv.jit objects and patches, they're free and pretty good.the documentation in the form of an overview is clear, you could use some of it out of the box.

there is also softvns, which is excellent but expensive.

then you could always make it yourself with standard jitterobjects.

store background in jit.matrix, then do an absolute difference (jit.op) with the incoming video.

do an absolute difference from the last frame to the next.

also do a search in the archives, this question comes up a lot.

the most important thing to be aware of is that motion tracking requires controlled lighting. any natural light in the room can be a problem.

Quote: Alise Ibort wrote on Sun, 11 February 2007 08:32
----------------------------------------------------
> Hello,
> I am working on an interactive video that requires that I motion track a person's movements with a webcam. The data from the webcam will then be routed into Jitter to play a movie clip. Specifically I am trying to match a person's gesture ie: wave, point, to a video of a person performing the same gesture. Does anybody have a sample patch or some starting tips on creating a patch for this?
>
> Thanks!
----------------------------------------------------

there is also softvns, which is excellent but expensive.
you can find most objects at http://maxobjects.com.

then you could always make it yourself with standard jitterobjects.
some basics:
for example background subtraction:
store background in jit.matrix, then do an absolute difference (jit.op) with the incoming video.
motion tracking:
do an absolute difference from the last frame to the next.

Also, there is eyesweb, which is free, available at eyesweb.org.

From the demos that I've seen of it, it appears to be very good at 

segmentation and recognition tasks. You'd have to do some bridging 

from eyesweb to Max via OSC or something similar. I believe it's PC 

 From the demos that I've seen of it, it appears to be very good at 
segmentation and recognition tasks.  You'd have to do some bridging 
from eyesweb to Max via OSC or something similar.  I believe it's PC 
only, unfortunately.

Quote: peter.mcculloch@gmail.com wrote on Sun, 11 February 2007 15:20

> Also, there is eyesweb, which is free, available at eyesweb.org.

> From the demos that I've seen of it, it appears to be very good at 

> segmentation and recognition tasks. You'd have to do some bridging 

> from eyesweb to Max via OSC or something similar. I believe it's PC 

OSC communication btw EyesWeb and Max works very well. It's worth it to have a windows computer running EyesWeb and simply sending the data you want to Max on your Mac or other Windows computer via OSC.

Quote: peter.mcculloch@gmail.com wrote on Sun, 11 February 2007 15:20
----------------------------------------------------
> Also, there is eyesweb, which is free, available at eyesweb.org.
>
>  From the demos that I've seen of it, it appears to be very good at 
> segmentation and recognition tasks.  You'd have to do some bridging 
> from eyesweb to Max via OSC or something similar.  I believe it's PC 
> only, unfortunately.
>
> Peter McCulloch
>
>
----------------------------------------------------

OSC communication btw EyesWeb and Max works very well.  It's worth it to have a windows computer running EyesWeb and simply sending the data you want to Max on your Mac or other Windows computer via OSC.

Motion Tracking