I'm starting a new thread on this, as I have a specific question that may need more attention:
Has anyone implemented an "automatic" kinect-projector calibration like the one implemented in VVVV by these guys?
I don't have a windows installation at the moment so I haven't tried it. But it seems to work fairly well (except that in the video he gets an calibration error above 1, which constitutes a calibration failure from what i've read elsewhere. The patch seems to wrap the openCV functions "cameracalibrate" and/or "projectorcalibrate" into vvvv.
Breatheren has shared a library on the following thread which seems to wrap some of these openCV functions, but adapted specifically for an led-tracking application:
(My first attempt at getting openCV installed on my mac has failed, but i'm willing to give it another shot if the tools can be adapted to kinect-projector calibration)
There are other posts by Ad. that suggest there is work on creating what could be used as the shader part of the patch: ie, creating a warped cg shader for use in reprojection.
there is also some helpful patches on in this thread on "undistorting" the kinect data here.
Also this thread suggests lembert.dome was working on this:
I also remember reading a diablodale post on the potential to implement this as part of his excellent jit.openni implemetation. (not sure where though)
I'm wondering if anyone has gotten this to work in max. The math and code in this is over my head, so I doubt I could do it myself. But would love to do this in the max world. Are there problems/issues preventing people in the max world to come up with as elegant a solution as the vvvv work in this direction? Is there an advantage in vvvv (other than the patch being already available)?
the patch ideally should project a checkerboard onto a piece of cardboard held up a various angles, sense where the cardboard is in 3d in each "snapshot", relative to the checkerboard corners, calibrate with calibratecamera, then create a shader that corrects the projection image accordingly.
Is anyone close?