Jack Forster

I am currently working on a project that involves the use of an Xbox Kinect to control the LCD draw screen.

I have used Synapse to read my left and right hand positioning, I now need to use this data to control the mouse input on the screen.

Does anyone know how I would be able to go about this?

 I am currently working on a project that involves the use of an Xbox Kinect to control the LCD draw screen. 

 I have used Synapse to read my left and right hand positioning, I now need to use this data to control the mouse input on the screen. 

 Does anyone know how I would be able to go about this?


controlling-lcd-draw-with-kinect

If you're after drawing curved lines with LCD, then I think ( I may be wrong), the best/ only way is to use the setpixel message, for example:

You will have to scale the kinect data appropriately for the LCD.

Could you explain your project a little further though? As I am too working on 'painting' with the Kinect, and maybe able to offer some advice.

[Kinect HandPosition]
            |      |
[pack    f     f     ]
    |
(setpixel $1 $2 255 0 0)
    |
[lcd]

basically the LCD will be used to control 3 different samples playback and pitch, the height of each line will determine the pitch and the length of each line will determine the length of playback. so yeah the lines need to be curved I will give what you suggest a go.

Well what I would suggest is that if the LCD isn't being used for visuals, just for data storage/writing/reading, I would use the data straight from the Kinect, and scale it down to what you need, and if you need to store the gesture data, do it using coll, not LCD. If however yo want the LCD for visual aid in doing so, the above method will work, however I would not use the LCD as a data read back system.

Here is a thread around capturing gesture data: -

I decided to use the kinect to hijack the mouse using the mxj Autobot. The problem I now have if the vertical movement is not in sync, what I mean is when I rase my arm up the mouse goes down. any idea of how to alter this?

Not sure if i understand your problem fully but if all you want to do is draw then why not just pack a line line to $1 $2 you could even use the z axis to control the weight. I haven't scaled the patch so you will need to add that.

Not sure if i understand your problem fully but if all you want to do is draw then why not just pack a line line to $1 $2 you could even use the z axis to control the weight.  I haven't scaled the patch so you will need to add that.


Well If what I think is happening is happening, you're getting increasing values from the Kinect (raising your hand).

The thing about the mouse is, it's values start from 0,0 (top left corner), to 1400,900 (bottom right corner). So if the value from the Kinect is going up, it will in fact move the mouse down, (what it sounds like you're experiencing).

- run all the Y axis data through a [* -1] object, this will flip the values.

- you then need to scale these values accordingly using the scale object. example:

Averagely, the data from the kinect ranges between -1000 to 1000. And your computer screen resolution, (what your mouse goes off), is 0-900. So what we want is a scale object like so-

(first two values are the Kinect range, second two values is your screen resolution range which will change depending on your resolution).

- run all the Y axis data through a [* -1] object, this will flip the values.
- you then need to scale these values accordingly using the scale object. example:

thanks chris I have managed to use the scale object to correct the Y axis! my project is almost finished! thanks for your help!

No problem, if you have any videos/ links about it when you're finished post it in this thread, I wouldn't mind seeing what you've been up to.

controlling LCD Draw with Kinect