Cycling 74 » Topic: use audio input change video color

use audio input change video color

rayon — Sun, 11 Nov 2007 05:53:34 +0000

Hi,

I’ll try the best to explain what I want but I apologize if this doesn’t make any sense.
I’m trying to use audio input to interactive with jitter video. What I want is that base on the audio input frequency and amplitude, the video change color.

I’ve search everywhere on the internet and couldn’t get any help at all.

Thank you!

rayon

Re: use audio input change video color

Rob Ramirez — Sun, 11 Nov 2007 08:07:57 +0000

maybe this will get you started.
this is for amplitude.
for frequency you want to download an external called fiddle~

#P user ezadc~ 47 46 91 79 0;
#P user jit.pwindow 234 290 82 62 0 1 0 0 1 0;
#P window setfont “Sans Serif” 9.;
#P window linecount 1;
#P newex 94 158 93 196617 scale 0. 1. 0. 360.;
#P flonum 235 200 49 9 0 0 0 3 0 0 0 221 221 221 222 222 222 0 0 0;
#P message 235 219 65 196617 hue_angle $1;
#P newex 235 245 39 196617 jit.hue;
#P flonum 270 68 35 9 0 0 0 3 0 0 0 221 221 221 222 222 222 0 0 0;
#P message 270 88 42 196617 rate $1;
#P message 330 68 83 196617 read dishes.mov;
#P flonum 229 68 35 9 0.5 0 1 3 0 0 0 221 221 221 222 222 222 0 0 0;
#P toggle 195 68 15 0;
#P newex 195 88 44 196617 metro 2;
#P newex 195 125 103 196617 jit.qt.movie 320 240;
#B color 5;
#P flonum 119 74 35 9 0 0 0 3 0 0 0 221 221 221 222 222 222 0 0 0;
#P newex 94 101 35 196617 *~ 1.;
#P newex 94 49 61 196617 cycle~ 500;
#P newex 94 129 69 196617 peakamp~ 40;
#P connect 11 0 15 0;
#P connect 4 0 11 0;
#P connect 14 0 13 0;
#P connect 0 0 14 0;
#P connect 12 0 11 0;
#P connect 13 0 12 0;
#P connect 10 0 9 0;
#P connect 7 0 5 1;
#P fasten 5 0 4 0 200 118 200 118;
#P fasten 8 0 4 0 335 115 200 115;
#P fasten 9 0 4 0 275 115 200 115;
#P connect 6 0 5 0;
#P connect 2 0 0 0;
#P connect 1 0 2 0;
#P connect 3 0 2 1;
#P window clipboard copycount 17;

Re: use audio input change video color

rayon — Sun, 11 Nov 2007 17:26:13 +0000

That helps a lot…
Okay, now I’m using peakamp~ and jit.brcosa in my patch. I am able to use audio input to change the brightness, contrast and saturation of the video. Great!!! Here comes my next question. If I want only one channel change saturation, say Red channel. What should I do???

Thank you very much!

Re: use audio input change video color

Rob Ramirez — Sun, 11 Nov 2007 23:58:49 +0000

jit.unpack.

also, if you are using peakamp~ with live input, i strongly suggest you look at and dissect jitter tutorial #28.

Re: use audio input change video color

rayon — Mon, 12 Nov 2007 04:27:22 +0000

Thanks! I’ll try it now.

Re: use audio input change video color

rayon — Mon, 12 Nov 2007 05:16:47 +0000

robtherich,

Thank you so much for your help. I am almost there…
I tried the jit.unpack and it does what I want. But here is another problem, when my audio input hooked up with the Rscale (to change red channel only), my video turn blue immediately. Suppose I want the video remain no change until there is a change in audio input then the video Red channel increases.

I hope this make sense.

Thank you again for your help!

Here is what I have:

#P window setfont “Sans Serif” 9.;
#P window linecount 1;
#P message 847 788 42 196617 jit.split;
#P message 804 788 42 196617 jit.pack;
#P message 752 788 51 196617 jit.concat;
#P comment 699 774 48 196617 see also:;
#P message 699 788 52 196617 jit.coerce;
#P button 569 788 15 0;
#P comment 585 790 112 196617 • view html reference.;
#P user jit.fpsgui 571 658 60 196617 0;
#P message 668 319 28 196617 stop;
#P comment 1066 787 43 196617 argb;
#P comment 1067 625 43 196617 blue;
#P comment 917 624 43 196617 green;
#P comment 748 623 43 196617 red;
#P comment 591 623 43 196617 alpha;
#P flonum 713 341 35 9 0 0 0 3 0 0 0 221 221 221 222 222 222 0 0 0;
#P message 713 363 51 196617 ascale $1;
#P user jit.pwindow 1299 596 162 122 0 0 0 0 1 0;
#P flonum 895 341 35 9 0 0 0 3 0 0 0 221 221 221 222 222 222 0 0 0;
#P flonum 837 341 35 9 0 0 0 3 0 0 0 221 221 221 222 222 222 0 0 0;
#P flonum 775 341 35 9 0 0 0 3 0 0 0 221 221 221 222 222 222 0 0 0;
#P message 895 363 51 196617 bscale $1;
#P message 837 363 51 196617 gscale $1;
#P message 775 363 51 196617 rscale $1;
#P newex 571 393 63 196617 jit.scalebias;
#P user jit.pwindow 1062 499 162 122 0 0 0 0 1 0;
#P user jit.pwindow 898 499 162 122 0 0 0 0 1 0;
#P user jit.pwindow 734 499 162 122 0 0 0 0 1 0;
#P user jit.pwindow 570 499 162 122 0 0 0 0 1 0;
#P newex 627 445 30 196617 print;
#P newex 571 424 66 196617 jit.unpack 4;
#B color 5;
#P flonum 699 298 35 9 0 0 0 3 0 0 0 221 221 221 222 222 222 0 0 0;
#P message 699 319 42 196617 rate $1;
#P message 636 319 28 196617 read;
#P flonum 605 298 35 9 0.5 0 1 3 0 0 0 221 221 221 222 222 222 0 0 0;
#P toggle 571 298 15 0;
#P newex 571 318 44 196617 metro 2;
#P newex 571 357 103 196617 jit.qt.movie 320 240;
#P window linecount 2;
#P comment 713 387 209 196617 scale argb , and notice the corresponding output matrices change in amplitude;
#P message 1553 425 88 196617 ; max hidemenubar;
#P message 1443 426 93 196617 ; max showmenubar;
#P window linecount 1;
#P newex 1443 394 129 196617 sel 0 1;
#P message 1296 348 70 196617 fullscreen $1;
#P toggle 1294 322 15 0;
#P newex 1297 292 52 196617 select 32;
#P newex 1297 263 40 196617 key;
#P newex 1175 384 196 196617 jit.window MoviePlayer 450 60 770 300;
#P message 1175 343 59 196617 floating $1;
#P toggle 1175 319 15 0;
#P window linecount 4;
#P comment 851 170 49 196617 argument causes automatic reporting;
#P window linecount 2;
#P comment 836 123 49 196617 reporting interval;
#P window linecount 1;
#P newex 775 222 75 196617 * 127.99;
#P number 840 148 35 9 0 0 1 3 0 0 0 221 221 221 222 222 222 0 0 0;
#P flonum 777 194 58 9 0 0 0 3 0 0 0 221 221 221 222 222 222 0 0 0;
#P newex 777 172 73 196617 peakamp~ 125;
#B color 5;
#P comment 593 94 36 196617 report;
#P flonum 638 160 58 9 0 0 0 3 0 0 0 221 221 221 222 222 222 0 0 0;
#P button 604 108 15 0;
#P message 638 65 65 196617 startwindow;
#P message 709 65 27 196617 stop;
#P newex 638 100 32 196617 adc~;
#P newex 638 138 52 196617 peakamp~;
#B color 5;
#P user panel 628 44 123 43;
#X brgb 255 255 255;
#X frgb 100 202 30;
#X border 2;
#X rounded 0;
#X shadow 0;
#X done;
#P connect 2 0 1 0;
#P fasten 2 0 8 0 643 130 782 130;
#P connect 27 0 26 0;
#P fasten 26 0 25 0 576 350 576 350;
#P fasten 29 0 25 0 641 345 576 345;
#P fasten 30 0 25 0 704 345 576 345;
#P fasten 53 0 25 0 673 345 576 345;
#P fasten 46 0 38 0 718 383 576 383;
#P fasten 39 0 38 0 780 383 576 383;
#P fasten 40 0 38 0 842 383 576 383;
#P fasten 41 0 38 0 900 383 576 383;
#P connect 25 0 38 0;
#P connect 38 0 32 0;
#P connect 32 0 34 0;
#P connect 34 0 54 0;
#P connect 28 0 26 1;
#P connect 32 4 33 0;
#P connect 4 0 2 0;
#P fasten 3 0 2 0 714 95 643 95;
#P fasten 5 0 1 0 609 133 643 133;
#P connect 1 0 6 0;
#P connect 31 0 30 0;
#P connect 47 0 46 0;
#P fasten 32 1 35 0 590 487 740 487;
#P connect 9 0 11 0;
#P connect 8 0 9 0;
#P connect 11 0 39 0;
#P connect 42 0 39 0;
#P connect 10 0 8 1;
#P connect 43 0 40 0;
#P connect 44 0 41 0;
#P fasten 32 2 36 0 604 477 904 477;
#P fasten 32 3 37 0 618 467 1068 467;
#P connect 14 0 15 0;
#P fasten 45 0 16 0 1305 383 1180 383;
#P fasten 20 0 16 0 1301 373 1180 373;
#P connect 15 0 16 0;
#P connect 18 0 19 0;
#P connect 19 0 20 0;
#P connect 17 0 18 0;
#P fasten 38 0 45 0 576 416 1228 416 1228 640 1305 640;
#P fasten 19 0 21 0 1299 339 1448 339;
#P fasten 21 0 22 0 1448 417 1448 417;
#P connect 21 1 23 0;
#P window clipboard copycount 62;

Re: use audio input change video color

Rob Ramirez — Mon, 12 Nov 2007 05:28:14 +0000

you need to find the range of the audio signal that you are using as the control signal. something like .001 to .5.
then you want to use the scale object to translate that range into your red video channel scale value:
scale .001 .5 1.0 2.0

you are going to want to clamp your control signal to that range, so that the scale value doesn’t dip below 1.0. again, you really want to look at that tutorial i mentioned, to find the best way to do this.

Re: use audio input change video color

rayon — Mon, 12 Nov 2007 19:55:31 +0000

Thanks again. I’m really just a beginner and learning everything on my own. Your reply helps a lot… I’ll check the tutorial again tonight.