Kinect perspective correction?

that should work. calibrating the 2 cams so they overlap nicely might be a pain though.

i’m doing a similar thing but with kinect skeleton tracking. in my motion tracked performance i need 360° freedom of movement so i need to prevent limbs being obscured to the camera. i use a 2nd kinect at 120° angle. both kinects perform skeleton tracking and i merge the 2 results together. it’s not super precise but good enough for my needs right now.

@mudang:

I’ve got 2 computers each running a Processing sketch which uses the SimpleOpenNI library for Kinect skeleton analysis. They both send their joint coordinates over OSC to Max running on one of the computers.

I draw the joints to a 3d GL context so I can manually rotate and translate the 2 skeletons till they overlap pretty good (compensating for the 120° horizontal angle, vertical angle, etc). I do this visually though I’m sure there’s more scientific methods to do this but this works for me for now. (Any tips on this?)

Then I have some logics going on to merge the 2 skeletons in 1 resulting skeleton. I iterate through all of the joints. If I have a valid reading (according to the confidence parameter) in both skeletons I take the average coordinate. If one is valid and one is invalid I take only the valid one. If none are valid I don’t update the joint.

Lastly I apply smoothing to the resulting skeleton.

(Btw, I hope that at some point the OpenNi/NITE libraries will have this built in, as well as fixing the 2 cam’s on 1 computer skeleton tracking issue. Doesn’t work as it should for now.)