[sharing is touching] Kinect based multi touch surface

Apr 4, 2013 at 3:34pm

[sharing is touching] Kinect based multi touch surface

I recently made a touch screen led wall for the Code Control Festival in Leicester, I was lucky to receive a Catalyst Award for it – thanks Cycling ’74, Leicester Phoenix, Sean, Arts Council etc.

Anyway building the wall took me ages and I had hardly any time left to do the software but I thought I’d share the kinect based touch system which is largely copy and pasted from the forums anyway.

The cameras were mounted directly above the wall looking down. I used 2 cameras in my installation but to keep it simple the attached patch is for one.

I discarded all the depth image except for the few cm adjacent to the touch surface and discarded all depth data not within a min and max threshold level.

I then applied Dieter Vandoren’s undistortion shader and used a combinaltion of a virtual camera in gl world and jit.gl.cornerpin to get a virtual image of my touchable surface.

I fed this to cv.jit.touches to get the touch data.

I had a few issues with calibration, using 2 cameras, and getting the kinect in the right plane but I was super impressed with the data coming out of the camera and the accuracy of cv.jit.touches (one caveat being I suspect a memory leak).

I think there is some mileage in the patch for someone anyway and there is definitely room for improvement. I don’t really understand the jit.gl stuff. I just managed to get it to work!

Hopefully it is understandable but if not give me a prod and I’ll try to explain it/sort it our.

– Pasted Max Patch, click to expand. –
#67517
Apr 4, 2013 at 3:39pm

wow , fantastic ! by the way Congratulations for the award !!!!! thank you

#242946
Apr 4, 2013 at 3:41pm

Thanks for sharing! And congratulations from me too! :)

#242947
Apr 7, 2013 at 8:51am

Glad to be of assistance and tanx for the credits! (makes me feel better about recycling other’s work all the time too ;)

#242948
Apr 7, 2013 at 4:58pm

this is great stuff, Gavin.

#242949
Apr 9, 2013 at 8:15am

Sounds cool!
Is there any video of this on the web?

#242950
Apr 18, 2013 at 8:04am

Yes there is this: http://vimeo.com/63900536

#242951
Apr 18, 2013 at 8:33am

Hey Gavin
many congrats, or “big up” as d’yoof would say.

Brendan

#242952

You must be logged in to reply to this topic.