jobbernaul

Hi, I have just started using Max/msp/jitter and i have decided to try and use the Kinect for a project.

I have jit.freenect.grab up and working fine but i am interested in pulling the raw data that the depth sensor collects. This is the part of my project that i really need at the moment and i cant work it out.

raw-data-from-kinect

the easiest way, is to make use of skeleton data, there is also Zachary Seldess Kinect depth-sensitive blob tracker, which is great tool if you are familiar with cv.jit objects :)

http://www.google.pl/#sclient=psy-ab&hl=pl&site=&source=hp&q=+site:cycling74.com+kinect&pbx=1&oq=+site:cycling74.com+kinect&aq=f&aqi=&aql=&gs_sm=12&gs_upl=712l712l0l3256l1l1l0l0l0l0l159l159l0.1l1l0&bav=on.2,or.r_gc.r_pw.,cf.osb&fp=26e2ad83e5cfdb8f&biw=1280&bih=829

and what do you want to do with it? :p
the easiest way, is to make use of skeleton data, there is also Zachary Seldess Kinect depth-sensitive blob tracker, which is great tool if you are familiar with cv.jit objects :)

i want to use the depth data to project live video footage on the the users silhouette through a projector. the live footage would be from the other side of a wall. so the project would create a kind of view through the wall within the users silhouette. i know it sounds completely mad but i am pretty curious to see if it work oh and its also my honours project.

i did a little installation around a similar idea. 2 spaces separated by a wall. misty 'see-through' with a kinect and beamer on each side: 

i used jit.freenect.grab which reads out the depth map. it's buggy though. memory leak and kinect output stalls under high CPU load.

right now i use a processing app using the simpleopenni library. it sends skeleton data as OSC to max. you could have processing read the depth map and send it to max using syphon. or ditch max altogether and do it in processing.

alternately, there's a kinect external for windows that might do what you want: 

https://cycling74.com/forums/here-is-my-working-jit-openni-max-jitter-openni-external-for-windows

i did a little installation around a similar idea. 2 spaces separated by a wall. misty 'see-through' with a kinect and beamer on each side: http://dietervandoren.net/filez/NVDD/

alternately, there's a kinect external for windows that might do what you want: https://cycling74.com/forums/here-is-my-working-jit-openni-max-jitter-openni-external-for-windows


i have some experience in processing but i think im going to solely try to build this in max/jitter just as a challenge. i managed to get a data read out from the depth sensor it seems a little messy so ill need to try and find away to clean up the data. It looks like synapse might be a good progression from here not entirely sure though.

yes actually just like that. the ballet dancing one is near enough the same except instead of block colours ill have live footage hopefully. very impressive stuff.

I used a jit.spill to acquire some data from the depth sensor but it seems to be really messy and slightly incoherent.

If anyone knows how to perhaps clean it up that would be great.

http://dtr.noisepages.com/2011/02/2-methods-for-undistorting-the-kinect-depth-map-in-maxjitter/

this might help: http://dtr.noisepages.com/2011/02/2-methods-for-undistorting-the-kinect-depth-map-in-maxjitter/


That looks really good but i keep getting a large number of errors or unsupported object.

Maybe i am being stupid but am i supposed to put the file into a jitter external folder or anything.

That looks really good but i keep getting a large number of errors or unsupported object. 

jit.gl.pbuffer: error binding invalid pbuffer!

jit.gl.texture: error binding readback mechanism for capture!

jit. gl.texture: float rgba textures not supported by hardware!

jit.gl.texture: unsupported texture format!

jit.gl.texture: unable to create texture!

thanks for the help. Im really lost just now

jit.gl.pbuffer: error binding invalid pbuffer!
jit.gl.texture: error binding readback mechanism for capture!
jit. gl.texture: float rgba textures not supported by hardware!
jit.gl.texture: unsupported texture format!
jit.gl.texture: unable to create texture!

thanks for the help. Im really lost just now 

looks like a rendering error, graphics card related. are you using max6? go to options > opengl status and change opengl readback to something else and see if it works.

btw, i don't think i 've run that patch in max6, only max5. although i don't see a reason why it wouldn't work in 6.

put 2 messages in your patch with contents: (including the semicolon)

try clicking each message before launching the kinect stuff and see if one works. if that doesn't work i'm out of ideas. perhaps your graphics card doesn't support shaders.

i am doing similar think and found that if you want to get nice and clean mask, you should have camera with ir bandpass, with the same focal lenght as projector + ir lighting - or maybe it it the easiest way :) if you get it working well let me know, I'll be very grateful :)

i am doing similar think and found that if you want to get nice and clean mask, you should have camera with ir bandpass, with the same focal lenght as projector  + ir lighting -  or maybe it it the easiest way :) if you get it working well let me know, I'll be very grateful :)
adam


Raw data from kinect