problem with mute~ pass~ output

i have a few effects subpatches running on a signal and i am trying to set it so when they are not in use, the dsp will shut them off to save some CPU.

sort like this ..

signal---->[p pitch]--->[p delay]--->[*~]-->[dac]

and then i have mute~ connected to the sub patches with the effects inside them (pitch is pfft gizmo object, and delay is some tapin tapout stuff).

the problem is, when i toggle the mute object on, instead of just turning off that effect and sending an uneffected signal through, it just kills the signal right there. i tried removing the pass~ object, but that gave major problems with amplitude.

it seems like i am missing something obvious here, can anyone shed some light on me?

another post suggested using poly~ objects, but i had the same problem with that method.

what am i doing wrong?!?!