Looking for advices for video broadcast

chapelier fou's icon

Hi,

I'm working on a project with 4 musicians playing alongside a full-featured movie.

The film is 1 .mp4 file and 3 audio files (dialogs, sound fxs, some music).

I will have to send some messages at precise moments of the timeline, from the video player to Ableton (handling the live music).

I'm looking for the most convenient way of doing this, and keeping it super reliable. The quality of the video output should be high enough (projected on a fairly large screen), smooth, and the synchro with the audio files should be accurate.

I tend to think that making my own player in Max would be super convenient as it could handle video and audio playing, and embed the "cue score" so it sends OSC messages to Ableton. Also, everything would be sent from stage.

Does it sound right to you ?

Any advice, issues that I might have overlooked ?

TFL's icon

The custom Max player seems like a fine approach to me! I think I would go this way.

Something else to try to help get everything in sync is to get all of your tracks as one big file. Since [jit.movie~] can apparently only play 2 channels audio, I suggest to keep the video on one file, and get all of your audio in one 6 channels audio file (for your 3 stereo tracks I guess).

Then you could do something like this.

chapelier fou's icon

Nice, thanks !

In the example you posted, I have a weird feeling about the "time_ms $1" message... I feel like it could make the video "stutter". Am I wrong ?

Rob Ramirez's icon

I would sync via 2 mechanisms that engage via some threshold delta, macro adjustments via time/position and micro via rate

chapelier fou's icon

@Rob Ramirez :

Could you be more precise ? Do you mean comparing the "audio time" with the "video time" and speed up/slow down video playback accordingly ?

Rob Ramirez's icon

yes. query audio time and video time at some rate (e.g. every second), compare the two, if abs diff is over some threshold increase or decrease jit.movie rate accordingly. if abs diff is over some other greater threshold, use jit.movie seeking.

riccardo dapelo's icon

HI. I have often used video playback directly in max for my performances (I talked about it here: https://cycling74.com/forums/best-solution-for-multiple-video-players). The only thing you have to be careful about is that after a certain amount of time I found that there are slight out of sync between audio and video. But if you intend to do audio processing directly in Ableton Live I would recommend using VideoSync https://videosync.showsync.com/ (unfortunately it is a paid software, but in my opinion it is worth the expense). Usually I use it and prepare my algorithms in Max4Live and do audio video (with any number of audio and video tracks) processing in a single environment and have the solidity of Ableton to maintain the sync between audio and video.

Just my two cents...

chapelier fou's icon

Thanks.

No audio processing, but rather a "parallel" music creation.

I'll come back here as soon as I have a player patch ready, but I think I've got all my questions covered (Still waiting for the "official" video and audio files).

Maybe just one : viddll or avf for this application ? I'm on Mac.

riccardo dapelo's icon

On Mac I've found best viddll