Video Pixel Displacement

Dear all,

is there a way to make a pixel displacement in one video stream based on the luminosity of a second video.
So the pixels in background Image / video footage are to be moved to the side based on brightness of the second video.
This should generate something like a cloaking coat / "predetor" effect.
(like this https://www.youtube.com/watch?v=0cu4dRZkqO0)

I assume it might work with jit.repos?
Not really sure how to process the the movie to work in repos though.

all the best, Frank