## jit.peek~ analysis

Sep 23, 2009 at 4:05pm

# jit.peek~ analysis

I’m making a Video to Audio project, and I’m using jit.peek~.

As it says in the help file, jit.peek~ reads matrix data as an audio signal. But how?

The third argument is for the plane, so it only analyze one of the tree RGB planes separately.

But how does this process works?

After some audio tests, I found this to be probably true:
jit.peek~ recognizes the color amount of one plain, and translates this to the amount of harmonics. The more color of a certain plain, the more harmonics one can listen to.

Am I correct? If not, please explain why.
Thank you all, and happy patching!

#45577
Sep 28, 2009 at 6:17pm

As I understand (please correct me if I’m wrong) from the help patch, the inputs of jit.peek~ determines the values for each dimension. In this case, X and Y. The number of dimensions are determined by the second argument. So, if the number is 3, we have 3 dimensions (which is odd to me, since a movie only has 2 dimensions. What would be the 3rd? And the 4th?).

jit.peek~ analize a single pixel, or a whole plane?

As I see, for example, green increasing in the movie, jit.peek~ changes the sound. What is this change? Is it frequency, is it harmonics? What numbers are these, and where are they from?

Here is a changed help max patch that I’m trying to understand:

– Pasted Max Patch, click to expand. –

…any help is truly apreciated. Thanks!

#164368
Oct 1, 2009 at 11:43am

I was fooling around with jit.peek~ for several days…

Tried different dimensions, besides (x,y), and they seem not to work…

I understand that the 1st two audio signals define the X and the Y of a single plane of the movie, but if one changes the phasor to other oscilator, it changes the sound.

What is happening, regarding DSP?
Is this a sum or multiplication os signals? What kind of synthesis is this?