Having problems modulating a circular buffer readpoint.

Here is my setup - 2 signal inputs with the second input modulating the delay readpoint, of which there are two.

When I multiply the first readpoint by the incoming 2nd signal and sum it with the second readpoint, I get modulation but it's not giving me the desired effect I want. Am I missing something obvious?