Isolating and projecting onto human silhouettes

aceslowman's icon

Hey everyone. I've dealt with kinect in the past, but have less experience in mapping to shapes. I currently have input through Synapse and simpleKinect. With that said, I wanted to get others opinions on the most efficient way to handle this. All I want is the silhouette of human shapes and the ability to map to the shape. I need to isolate only those, and with that, apply effects around the shape. Is either Synapse or simpleKinect overkill for this? I don't need any particular skeleton data necessarily, and honestly I feel like this ends up landing in openCV territory or something, via contour tracking and maybe some sort of classifier? Also, any recommendation on where to start thinking about the mapping? I'll likely buy a copy of MadMapper and send from Max via Syphon. Included are my specs just in case that somehow factors into things. Thanks!

Specs:

OS X El Capitan (10.11)
MacBook Pro (13-inch, Mid 2012)
2.9 GHz Intel Core i7
8GB RAM
Intel HD Graphics 4000 1536 MB

metamax's icon

You can convolve an image with a sobel filter or similar edge-detecting kernel to highlight boundaries. cv.jit is the goto blob tracking library in Max. http://jmpelletier.com/cvjit/.

phiol's icon

here's a nice sobel type filter
"edge maker" patch I pick up

Max Patch
Copy patch and select New From Clipboard in Max.

AS for mapping that is a large topic:

do you simpply want to use the kinect silhouette to as a mask for projected content.
do you wanna use the depthmap to affect the z depth (displacement) of a a mesh/nurb.
like you see here https://www.youtube.com/watch?v=HRqVZ7YTUcA
have both cutout and depth mapping to nurb.

phiol

phiol's icon

here's a nice sobel type filter
"edge maker" patch I pick up

Max Patch
Copy patch and select New From Clipboard in Max.

AS for mapping that is a large topic:

do you simpply want to use the kinect silhouette to as a mask for projected content.
do you wanna use the depthmap to affect the z depth (displacement) of a a mesh/nurb.
like you see here https://www.youtube.com/watch?v=HRqVZ7YTUcA
have both cutout and depth mapping to nurb.

and there is much more.
infrared beacons etc...

phiol

metamax's icon

This is a really nice filter. Here it is with a single function + params that affect edge sensitivity in specific channels, edge sharpness, contrast and y-displacement. Super impressed by the precision and detail. Thank you for sharing!

Max Patch
Copy patch and select New From Clipboard in Max.

phiol's icon

woah ! what a nice tweak !
thanks metamax

I can't find the original creator, I wanna credit him.

phiol

2K's icon

Here is the original post where the Sobel and Robert Cross filter types shaders were shared, https://cycling74.com/forums/edge-detection-objects

phiol's icon

thanks a lot 2k :-) !