Cycling 74 » Topic: Movie Audio…?

Movie Audio…?

grimepoch — Mon, 16 Jul 2007 00:32:21 +0000

I have two movies playing and I’d like to not only mix the output together, but put some filters before the mix. I can see how to use spigot to pull a copy of the audio off of the video, is this the only way? I imagine I could set the audio volume to 0 if I do this.

Is there a better way? I want to make sure the video and audio stay in sync.

Thanks!

Rick

Re: Movie Audio…?

Nadav Assor — Mon, 16 Jul 2007 09:08:07 +0000

You can search the list, lots of threads about a/v syncing. Spigot is, at least in my experience, not recommended and unreliable.
The best thing to do would be to seperate the audio from the video files using quicktime or a batch utility of some sort (compressor, canopus procoder, etc.). Then you can play them in sync using msp to drive the movie instead of metro. For a recent installation of mine I used a patch I made based on a patch Johnny dekam posted on the list a while ago. I’m attaching it here, it’s reasonably organized though quite basic. Maybe it’ll help.
-Nadav

#P window setfont “Sans Serif” 9.;
#P window linecount 1;
#P comment 320 166 160 9109513 clear saved file menus if you wish;
#P comment 320 438 86 9109513 Nadav Assor 2007;
#P comment 320 423 225 9109513 Based on msp-video sync patch by Johnny Dekam;
#P window linecount 8;
#P comment 320 292 87 9109513 *notes: speed doesn’t have reverse mode , gain sliders aren’t linked , time slider currently only 1 way (no scrubbing) – these are easy to change;
#P window linecount 1;
#P message 195 77 28 9109513 clear;
#P comment 38 42 89 9109513 Metro & Audio on;
#P comment 320 259 87 9109513 turn up the volume;
#P comment 320 213 76 9109513 select video clip;
#P comment 320 244 57 9109513 click restart;
#P comment 320 229 48 9109513 click play;
#P comment 104 119 35 9109513 restart;
#P comment 31 119 55 9109513 Play / Stop;
#P comment 320 197 98 9109513 turn on metro & audio;
#P window setfont “Sans Serif” 12.;
#P comment 320 147 48 9109516 Playing;
#P window setfont “Sans Serif” 9.;
#P window linecount 2;
#P comment 320 41 241 9109513 Seperate the audio from your video files into seperate aif files (easy to do via batch processing software);
#P window linecount 1;
#P comment 320 181 160 9109513 drag the “master” folder to the patch;
#P window linecount 3;
#P comment 320 71 213 9109513 make a master folder containing a “video” and an “audio” folder , each with files of the same name but with .mov extension for video , .aif for audio;
#P user meter~ 110 156 126 214 50 0 168 0 103 103 103 255 153 0 255 0 0 217 217 0 153 186 0 12 3 3 3 3;
#P user gain~ 127 156 19 35 158 0 1.071519 7.94321 10.;
#P user meter~ 63 156 79 214 50 0 168 0 103 103 103 255 153 0 255 0 0 217 217 0 153 186 0 12 3 3 3 3;
#P window linecount 1;
#P hidden message 231 104 37 9109513 size $1;
#P user hslider 30 141 12 144 34680 1 0 0;
#P hidden newex 231 124 53 9109513 r currtime1;
#B color 5;
#P hidden newex 231 82 66 9109513 r clipduration1;
#B color 5;
#P user gain~ 80 156 19 35 158 0 1.071519 7.94321 10.;
#P hidden newex -113 60 57 9109513 r snapbeat1;
#B color 14;
#P hidden newex -185 137 59 9109513 s snapbeat1;
#B color 14;
#P hidden newex -185 113 38 9109513 qlim 33;
#P window linecount 2;
#P hidden comment -123 85 95 9109513 6 receives (2 local) , 6 sends(2 loc , 2 msp);
#P hidden comment -61 157 63 9109513 path making for A&V;
#P window linecount 1;
#P hidden message -60 397 68 9109513 fullscreen $1;
#P hidden toggle -77 397 15 0;
#P hidden newex -35 372 35 9109513 sel 27;
#P hidden newex -80 373 40 9109513 key;
#P window setfont “Arial Black” 12.;
#P comment 14 96 16 9633804 A;
#B color 7;
#P window setfont “Sans Serif” 9.;
#N vpatcher 784 78 1129 230;
#P window setfont “Sans Serif” 9.;
#P newex 142 95 54 9109513 s audread1;
#B color 5;
#P newex 50 96 52 9109513 s vidread1;
#B color 5;
#P newex 142 71 64 9109513 prepend open;
#P newex 50 72 88 9109513 prepend asyncread;
#N vpatcher 35 85 169 331;
#P window setfont “Sans Serif” 9.;
#P window linecount 1;
#P newex 83 50 14 9109513 _;
#P window linecount 7;
#P message 50 76 51 9109513 D:/Documents/projects/tangles_AMD/vids/drummerclips/video/drummer6.mov;
#P inlet 50 56 15 0;
#P inlet 83 30 15 0;
#P outlet 50 176 15 0;
#P connect 2 0 3 0;
#P connect 4 0 3 0;
#P connect 3 0 0 0;
#P connect 1 0 4 0;
#P pop;
#P newobj 50 50 61 9109513 p symbolbuf;
#P inlet 50 30 15 0;
#P inlet 142 51 15 0;
#P inlet 101 30 15 0;
#P connect 2 0 3 0;
#P connect 3 0 4 0;
#P connect 4 0 6 0;
#P connect 0 0 3 1;
#P connect 1 0 5 0;
#P connect 5 0 7 0;
#P pop;
#P hidden newobj -100 189 70 9109513 p makeoutputs;
#B color 6;
#N vpatcher 25 70 394 264;
#P window setfont “Sans Serif” 9.;
#P newex 127 99 74 9109513 prepend prefix;
#P newex 127 74 73 9109513 sprintf %saudio;
#P newex 50 74 74 9109513 sprintf %svideo;
#P newex 50 98 74 9109513 prepend prefix;
#P inlet 80 26 15 0;
#P inlet 50 25 15 0;
#P outlet 50 122 15 0;
#P outlet 127 123 15 0;
#P message 80 48 103 9109513 D:/somepathc/avclips/;
#P comment 118 31 55 9109513 saved path;
#P connect 1 0 7 0;
#P connect 4 0 7 0;
#P connect 7 0 6 0;
#P connect 6 0 3 0;
#P connect 5 0 1 0;
#P connect 4 0 8 0;
#P connect 1 0 8 0;
#P connect 8 0 9 0;
#P connect 9 0 2 0;
#P pop;
#P hidden newobj -102 140 55 9109513 p pathstuff;
#B color 6;
#P button 87 75 19 0;
#P window setfont “Arial Black” 12.;
#P comment 120 95 16 9633804 V;
#B color 5;
#P window setfont “Sans Serif” 9.;
#P hidden newex -100 164 27 9109513 t b i;
#P user ubumenu 32 96 83 9109513 0 1 1 0;
#X setrgb 31 31 31 143 221 142 234 234 234 4 4 4 141 141 141 112 112 112;
#X add;
#X prefix_set 0 1 0;
#X pattrmode 1;
#P user ubumenu 135 96 86 9109513 0 1 1 0;
#X setrgb 31 31 31 236 227 101 234 234 234 4 4 4 141 141 141 112 112 112;
#X add;
#X prefix_set 0 1 0;
#X pattrmode 1;
#P user dropfile 15 74 88 94 0;
#P window setfont “Sans Serif” 12.;
#P message 14 75 73 9109516 Drag Folder;
#B color 4;
#P window setfont “Sans Serif” 9.;
#P comment 106 78 89 9109513 or bang saved path;
#N vpatcher 1 296 761 774;
#P origin -8 1;
#P window setfont “Sans Serif” 9.;
#P window linecount 0;
#P newex 71 232 70 9109513 r ch1_vol_msp;
#B color 5;
#P flonum 71 257 35 9 0 0 0 139 0 0 0 221 221 221 222 222 222 0 0 0;
#P newex 110 289 28 9109513 *~ 1.;
#P newex 32 288 28 9109513 *~ 1.;
#P comment 667 300 48 9109513 3 Sends;
#P newex 280 242 38 9109513 s loop1;
#B color 5;
#N vpatcher 15 55 124 184;
#P window setfont “Sans Serif” 9.;
#P newex 68 73 19 9109513 t b;
#P newex 50 50 28 9109513 sel 0;
#P inlet 50 30 15 0;
#P outlet 68 97 15 0;
#P outlet 50 74 15 0;
#P connect 2 0 3 0;
#P connect 3 0 0 0;
#P connect 3 1 4 0;
#P connect 4 0 1 0;
#P pop;
#P newobj 105 117 29 9109513 p tog;
#B color 6;
#N comlet audioL;
#P outlet 299 428 15 0;
#N comlet audioR;
#P outlet 327 428 15 0;
#P window setfont “Sans Serif” 14.;
#P window linecount 1;
#P comment 151 25 100 9109518 Audio;
#P window setfont “Sans Serif” 9.;
#N vpatcher 25 70 338 272;
#P window setfont “Sans Serif” 9.;
#P window linecount 0;
#P newex 191 142 68 9109513 s clipduration1;
#B color 5;
#P number 191 73 89 9 0 0 0 139 0 0 0 221 221 221 222 222 222 0 0 0;
#P newex 119 143 61 9109513 s timescale1;
#B color 2;
#P window linecount 2;
#P comment 99 92 100 9109513 send timescale to calculate ms to time;
#P number 89 74 91 9 0 0 0 139 0 0 0 221 221 221 222 222 222 0 0 0;
#P window linecount 1;
#P newex 50 70 20 9109513 t b;
#P newex 50 143 63 9109513 s load_done1;
#B color 2;
#P newex 50 50 129 9109513 route read timescale duration;
#P inlet 50 30 15 0;
#P connect 0 0 1 0;
#P connect 1 0 3 0;
#P connect 3 0 2 0;
#P connect 1 1 4 0;
#P connect 4 0 6 0;
#P connect 1 2 7 0;
#P connect 7 0 8 0;
#P pop;
#P newobj 666 280 79 9109513 p syncvid_router;
#B color 6;
#P comment 487 381 184 9109513 turn on main metro , main msp;
#P comment 487 415 184 9109513 hit start (can be loadbanged);
#P comment 486 398 184 9109513 turn on the patchs metrogate;
#P window linecount 2;
#P comment 485 352 184 9109513 shortversion: open vidfile with matching aud file using avfolders patch.;
#P window linecount 1;
#P newex 109 310 65 9109513 send~ audioR;
#B color 5;
#P newex 32 310 63 9109513 send~ audioL;
#B color 5;
#P message 410 181 45 9109513 time $1;
#P newex 619 92 27 9109513 gate;
#P newex 516 50 50 9109513 r vidread1;
#B color 5;
#P newex 151 54 52 9109513 r audread1;
#B color 5;
#P flonum 55 98 35 9 0. 2. 7 139 0 0 0 255 227 23 222 222 222 0 0 0;
#P message 55 118 46 9109513 speed $1;
#P message 129 145 39 9109513 resume;
#P newex 219 241 57 9109513 r snapbeat1;
#B color 5;
#P newex 207 263 55 9109513 snapshot~;
#P newex 207 283 40 9109513 change;
#P newex 410 155 53 9109513 r currtime1;
#B color 5;
#P newex 249 305 59 9109513 r timescale1;
#B color 2;
#P newex 198 358 55 9109513 s currtime1;
#B color 5;
#P window linecount 6;
#P comment 265 327 94 9109513 send time $1 to all movies you wish to sync (assuming they all have the same duration and timescale);
#P window linecount 1;
#P comment 249 123 149 9109513 4. start by playing sound file;
#P comment 267 211 41 9109513 loop;
#P comment 647 71 118 9109513 3. start metro , and dsp;
#P window linecount 2;
#P comment 429 117 184 9109513 2. Read in the corresponding movie file – but @autostart is set to ’0′;
#P comment 97 328 106 9109513 convert sound’s ms to movie ‘time’ values;
#P window linecount 1;
#P newex 236 166 21 9109513 t 1;
#P button 236 129 15 0;
#P newex 180 166 21 9109513 t 0;
#P message 180 145 51 9109513 beginning;
#P newex 482 156 61 9109513 r load_done1;
#B color 2;
#P newex 207 328 52 9109513 * 2997.;
#P message 482 180 125 9109513 gettimescale , getduration;
#P message 92 145 35 9109513 pause;
#P newex 207 305 41 9109513 * 0.001;
#P message 59 145 30 9109513 open;
#N sfplay~ 2 60000 1 ;
#P newobj 151 209 95 9109513 sfplay~ 2 60000 1;
#P toggle 619 70 15 0;
#P message 398 126 30 9109513 read;
#P newex 515 257 229 9109513 jit.qt.movie 640 480 @colormode uyvy @autostart 0;
#P window linecount 4;
#P comment 405 234 100 9109513 leave ‘play’ off and drive the movie time values from soundfile position;
#P window linecount 3;
#P comment 0 185 149 9109513 1. open a sound file , which matches the duration of the movie (exported from movie as .AIF eg);
#P user panel 479 349 199 85;
#X brgb 255 255 255;
#X frgb 100 202 30;
#X border 2;
#X rounded 0;
#X shadow 0;
#X done;
#P window setfont “Sans Serif” 14.;
#P window linecount 1;
#P comment 517 25 100 9109518 Video;
#N comlet speed 0. – 2.;
#P inlet 437 21 15 0;
#N comlet start – anything;
#P inlet 379 22 15 0;
#N comlet metro gate on;
#P inlet 342 22 15 0;
#N comlet metro beat;
#P inlet 320 21 15 0;
#P outlet 266 429 15 0;
#P user panel 394 47 367 300;
#X brgb 191 191 191;
#X frgb 0 0 0;
#X border 4;
#X rounded 10;
#X shadow 0;
#X done;
#P user panel 8 47 371 371;
#X brgb 191 191 191;
#X frgb 0 0 0;
#X border 4;
#X rounded 10;
#X shadow 0;
#X done;
#P connect 14 0 57 0;
#P connect 57 0 44 0;
#P connect 59 0 57 1;
#P connect 6 0 39 0;
#P connect 39 0 38 0;
#P connect 60 0 59 0;
#P connect 54 0 17 0;
#P connect 13 0 54 0;
#P connect 58 0 45 0;
#P connect 14 1 58 0;
#P connect 59 0 58 1;
#P connect 54 1 37 0;
#P fasten 22 0 14 0 185 192 156 192;
#P connect 38 0 14 0;
#P connect 37 0 14 0;
#P fasten 17 0 14 0 97 192 156 192;
#P fasten 15 0 14 0 64 192 156 192;
#P fasten 24 0 14 0 241 192 156 192;
#P connect 40 0 14 0;
#P connect 21 0 22 0;
#P connect 22 0 31 0;
#P connect 19 0 31 0;
#P connect 14 2 35 0;
#P connect 36 0 35 0;
#P connect 35 0 34 0;
#P connect 34 0 16 0;
#P connect 16 0 19 0;
#P connect 5 0 23 0;
#P fasten 14 3 24 0 240 232 265 232 265 162 241 162;
#P fasten 23 0 24 0 241 148 241 148;
#P connect 32 0 19 1;
#P connect 11 0 2 0;
#P connect 14 3 55 0;
#P connect 14 0 53 0;
#P connect 14 1 52 0;
#P connect 33 0 43 0;
#P connect 20 0 18 0;
#P connect 42 0 11 0;
#P fasten 12 0 11 0 403 229 520 229;
#P fasten 18 0 11 0 487 209 520 209;
#P connect 41 0 11 0;
#P fasten 43 0 11 0 415 219 520 219;
#P connect 4 0 13 0;
#P connect 13 0 42 0;
#P connect 3 0 42 1;
#P connect 11 1 50 0;
#P pop;
#P hidden newobj -112 117 84 9109513 p av_sync_player;
#B color 6;
#P button 90 119 15 0;
#P hidden newex -185 87 48 9109513 metro 0.5;
#P toggle 9 33 27 0;
#P toggle 16 119 16 0;
#P flonum 171 119 35 9 0. 2. 7 139 0 0 0 221 221 221 222 222 222 0 0 0;
#P hidden newex 231 169 76 9109513 receive~ audioR;
#B color 5;
#P hidden newex -182 240 28 9109513 dac~;
#P hidden newex 231 146 74 9109513 receive~ audioL;
#B color 5;
#P hidden newex -112 416 370 9109513 jit.window timecode_example @size 640 480 @interp 1 @colormode uyvy @floating 1;
#P comment 141 119 31 9109513 speed;
#P window setfont “Sans Serif” 12.;
#P comment 320 23 100 9109516 Preparation:;
#P user panel 5 65 225 158;
#X brgb 181 181 181;
#X frgb 0 0 0;
#X border 4;
#X rounded 10;
#X shadow 0;
#X done;
#P hidden connect 53 0 17 0;
#P hidden connect 53 0 16 0;
#P hidden connect 34 0 37 0;
#P hidden connect 21 0 16 0;
#P hidden connect 6 0 39 0;
#P hidden connect 39 0 5 1;
#P hidden connect 39 0 40 0;
#P hidden connect 4 0 33 0;
#P hidden connect 33 0 5 0;
#P hidden connect 33 0 38 0;
#P hidden connect 18 1 17 0;
#P hidden connect 21 1 17 0;
#P hidden connect 35 0 36 0;
#P hidden connect 37 0 36 0;
#P hidden connect 24 0 25 0;
#P hidden connect 17 1 22 2;
#P hidden connect 7 0 12 3;
#P hidden connect 20 0 21 1;
#P hidden fasten 26 0 27 0 -61 412 -61 397;
#P hidden connect 11 0 12 2;
#P hidden connect 16 1 22 1;
#P hidden fasten 25 0 26 0 -30 394 -72 394;
#P hidden connect 8 0 12 1;
#P hidden connect 18 0 22 0;
#P hidden connect 16 0 18 0;
#P lcolor 1;
#P hidden connect 15 0 21 0;
#P hidden connect 27 0 3 0;
#P hidden connect 12 0 3 0;
#P hidden connect 32 0 12 0;
#P lcolor 15;
#P hidden connect 9 0 10 0;
#P hidden connect 9 0 5 0;
#P hidden connect 30 0 31 0;
#P hidden connect 10 0 30 0;
#P lcolor 15;
#P window clipboard copycount 58;

Re: Movie Audio…?

Jeremy Bernstein — Mon, 16 Jul 2007 09:22:26 +0000

I’d be very interested in hearing a slightly more fleshed out version
of this critique.

Am 16.07.2007 um 11:08 schrieb Nadav Assor:

> Spigot is, at least in my experience, not recommended and unreliable.

Re: Movie Audio…?

Gregory Taylor — Mon, 16 Jul 2007 14:07:09 +0000

>I’d be very interested in hearing a slightly more fleshed out
>version of this critique.
>
>jb
>
>Am 16.07.2007 um 11:08 schrieb Nadav Assor:
>
>>Spigot is, at least in my experience, not recommended and unreliable.

That makes two of us. In particular, under what situations is Spigot
unreliable?
(platform, OS version, Jitter version, etc. would be helpful, since perhaps my
system is immune or something). While the somewhat recent alterations in the
way that Spigot works was necessitated by changes Apple made over which
we have no control whatsoever [i.e. Apple switched QuickTime's audio system
to CoreAudio, and, in doing so, removed the ability for audio to be routed to
an arbitrary destination], it would be useful to know what the current problems
with what we do have are.
–
on the floor there’s a long wooden table/on the table there’s an open book/
on the page there’s a detailed drawing/and on the drawing is the name I took
Gregory Taylor http://www.rtqe.net

Re: Movie Audio…?

pieter.coussement — Mon, 16 Jul 2007 14:20:11 +0000

I can say I’ve used spigot for some audio routing things, and must
say it isn’t that reliable either. What I noticed is that once spigot
made a xmltype file for every movie file I was going to include in
the patch everything worked out fine, but at first the patch needed
to run through every moviefile once before it did what it supposed to
do without hickups. Another thing I noticed is that when I tried to
have a movie with audio routing through spigot and an extra sfplay~
in the patch performance really dropped. Of cource all this could be
related to ineffective patching from my side but I haven’t have the
best experiences either with spigot~

best

pieter

On 16 Jul 2007, at 13:22, Jeremy Bernstein wrote:

> I’d be very interested in hearing a slightly more fleshed out
> version of this critique.
>
> jb
>
> Am 16.07.2007 um 11:08 schrieb Nadav Assor:
>
>> Spigot is, at least in my experience, not recommended and unreliable.
>
>

Re: Movie Audio…?

grimepoch — Mon, 16 Jul 2007 14:57:58 +0000

I can say this about spigot~

1. reading a movie into a jit.qt.movie causes a glitch in video playback (on another jit,qt.movie).

2. It takes A LOT longer than buffer~ to grab the audio on the first time with a movie. On a 320×240 mp4 (iTunes quality encoding) it took 1:34 minutes before the spigot started outputting audio.

3. Files that are over a certain length (so they contain the #A7BC84 or similar in the name) do not work with @spigot, short names do.

And thanks for the other patch, I will give it a try and see how it works. My BIGGEST concern is all methods for extracting audio inside max/msp seem to stall video output. Audio output remains okay. They REALLY need a flag for this somewhere to give it higher priority.

Re: Movie Audio…?

Nadav Assor — Mon, 16 Jul 2007 22:32:24 +0000

I’m sorry, that was indeed poorly phrased, guess I wasn’t fully awake yet…
I would be the first to jump with joy at the message that spigot now works fine with qt7. I simply meant that my purely personal preference at the moment is to avoid using spigot when possible, because of the various issues it has (or had.. hadn’t used it in a few months so maybe things changed) with qt7, and because of statements made by c74 that fixing these is a low priority issue. The errors and trouble I had using spigot aren’t new or different than things discussed previously in the forum, which is why I didn’t post about them in the first place. But I could have made my remark more specific instead of sounding like I’m dismissing the whole object altogether.. which of course I’m not.
I just like to have my workflow as simple as possible, and in a context where I work with a pool of known materials, I prefer to split them beforehand, non-realtime, then use msp-synced playback- it just feels more efficient and less error prone than relying on yet another realtime component that is not even entirely the responsibilty of c74 (because of the qt connection) to function properly.

-n

Re: Movie Audio…?

Andrew Benson — Mon, 16 Jul 2007 22:56:12 +0000

Hi Nadav,
It sounds like you are doing by hand exactly what spigot~ does
automatically. But if it feels right, who am I to stop you…

As always, we are happy to hear any specific bug reports and feature
requests, as long as they are accompanied by the appropriate info and
examples. Saying that something is “error prone” doesn’t do much to
inspire us.

Best,