continuous slider from random start points - Leap motion

I'm using the Leap Motion to control some sliders. When I put my hand over the sensor it jumps to that value, say I'm halfway up it starts at 50 and at the highest point is 127. When I remove my hand it stays where it is left off, which good, but when I put my hand back in at any other random point all of a sudden slider jumps to wear my hand is entered. So, hand in 0-60, remove hand slider stays at 60, hand back in 95-0. I'd love it if when my goes to do the second move, that the value doesn't jump up suddenly from 60 to 95, but continue from 60 regardless from where I start on the second move.

right now I'm running some smoothing algorithm, but not the best solution.

Please help, or point me in the right direction.

I attached a patch the illustrates the issue. the section the LEFT with the urn and line objects is just to show the kind of input I get with the sensor. the MIDDLE part is a little something that captures the last value when I remove my hand. the RIGHT is the Slider that I'd like to finally effect, which will control the gain of a looped tonal sample.