I'm having trouble figuring out how to get a depth informed color image out of kinect. I can get the rgb image and the depth point map separately but I'm not sure how to marry them.
Do you draw a point map, then paint each point the color associated with the rgb? (How do you specify colors per point?)
Or do you take the rgb information and give it depth?
I'm trying to make color 3d points that I can fly around with the [jit.gl.camera].