Audio/Video - Sync - extending A. Benson's Video Processing System

user7777's icon

First of all, thanks, Andrew, for the great template and description.

Just looking for some general advice about multiple movies playing with corresponding audio files playing in sync. In my current performance setup there are a three sfplay objects being 'snapshotted' for their current playback position, the respective times are appropriately scaled to control the time sent to the three qt.movie objects.

Wondering how we can sync audio in a scenario such as Andrew's patch where the qt.movie objects are paced inside a poly~ object.
I'm referring to the final installment of the article to be found here: https://cycling74.com/tutorials/the-video-processing-system-part-4/

Is it advisable to also place the controlling sfplay object inside the poly object with the qt.movies? (Per the example, it would be placed inside vps.pmovie patch).

Or,.. should I use a 'send' to send the current time to the movie object with a message like "target $1, time 3000"?

I'm open to other approaches as well. This seems like a very common problem and, I imagine, has a few solutions.

Thanks for any hints!!!

Rob Ramirez's icon

either of those approaches would work. it depends on your specific needs.
if each movie has its own unique soundtrack, then it probably makes sense to load each soundtrack in the corresponding poly~

you will generally want to sync the movie playback to the soundtrack using the frame message (first converting the time value from your audio player, eg sfplay~, to fps).

also, fellow cycling employee mr wakefield created some abstractions for this, that might be better for your needs.
http://www.mat.ucsb.edu/~wakefield/software.html#waaa

user7777's icon

Thanks for your response, Rob!
I will try to make use of the WAAA abstractions - looks like they will do the trick.