poly~ noob question.

My plan is to have a poly object like to one I've pasted below for each of twelve tones in a microtonal sampler that gets it's input from fiddle~ rather than from a midi controller. When you sing the right notes into the mic, it plays back samples. Each poly will have 5 instances (five octaves) This works but it doesn't mute the unused voices. Can someone tell me why?