Gen Looper Syncing via plugsync~ (or is there a better options)

I'm making a simple looper which:

• should be able to have a length of any number of beats.

• should be synced to ableton's transport.

I made a simple example of how I thought this should work using phasor~ locked to 4n to peek from a buffer, and plugsync~ to keep track of its state in the ableton project. The problem I'm running into is that I often hear a click with each beat. I think what's happening is that adding the beat from plugsync~ to the phase value from phasor~ is causing the peek sample index to skip, and click as result. Wondering what a better way or handling this might be? Thanks!