Noisey Parker

I have designed an FM synthesis patch that converts MIDI to Hertz to control the cycle~ object. I also use note scaling to keep the object within a selected scale. However there is a lag between the midi input and the hertz output and it's messing up my patch and creating horrible lurches! It's driving me up the wall and if anyone knows how to rectify the lag then it would be amazing.

MIDI into 'mtof' object and scaled into dorian, ionian etc has a delay...Help!