your problem is not very clear to me from what you describe.
To me the yellow, blue and purple planes don't move relative to each other.
If you move the camera, the point of view changes, and obviously, the
planes will move *on the jit.window screen*, but they don't move
the floor plane.
(Which seems rather normal with respect to real life conventions,
directors would really have made that matrix revolution)
FWIW, your yellow, blue and purple planes are crossing the floor, which
what you call scrubbing, but thats just a matter of positionning your
the right place.
Also note that if you move the camera along the x-axis, without movin
parameter at the same time, you will get a "turning around your scene"
rather than a travelling effect.
hope this helps