Help : Dynamically changing live.remote targets problems

I've been toying with this idea of a "contextual mapper" in M4L.
The basic concept is to store and recall presets of bindings from a single MIDI CC to different parameters in Live. So depending on the context the same controller encoder would control this or that parameter.

basic function under the hood would be :

- get the value, the min and the max of the new grabbed param
- scale the value to the 0-127 for the MIDI controller
- scale the MIDI controller value to the param min/max.
- control the param from the controller.

here's a patch that seem to work on edit mode, but can act weirdly in "normal" mode when the editor is closed.
To test, first map two different params with the store messages. Then you can toggle between the two controls with the toggle box. The dial controls the param.
PROBLEM : if you store two params with different ranges, e.g. a send (0. 1.) and a pan (-1. 1.), and stupidly click several times on the toggle and don't even touch the control dial, you'll see the pan increasing by itself. The problem does not occur in edit mode.

Any idea where the issue could be ?