I’m making a Video to Audio project, and I’m using jit.peek~.
As it says in the help file, jit.peek~ reads matrix data as an audio signal. But how?
The third argument is for the plane, so it only analyze one of the tree RGB planes separately.
But how does this process works?
After some audio tests, I found this to be probably true:
jit.peek~ recognizes the color amount of one plain, and translates this to the amount of harmonics. The more color of a certain plain, the more harmonics one can listen to.
Am I correct? If not, please explain why.
Thank you all, and happy patching!
jit.peek~ simply reads the value of one plane’s cell of a matrix, and converts it to an audio signal. which cell is read is determined by the audio signal inputs to jit.peak~.
color and harmonics have nothing to do with it. it’s all just numbers.
perhaps if you provide a patch, which illustrates what is not clear, we will be able to provide further explanation.
As I understand (please correct me if I’m wrong) from the help patch, the inputs of jit.peek~ determines the values for each dimension. In this case, X and Y. The number of dimensions are determined by the second argument. So, if the number is 3, we have 3 dimensions (which is odd to me, since a movie only has 2 dimensions. What would be the 3rd? And the 4th?).
jit.peek~ analize a single pixel, or a whole plane?
As I see, for example, green increasing in the movie, jit.peek~ changes the sound. What is this change? Is it frequency, is it harmonics? What numbers are these, and where are they from?
Here is a changed help max patch that I’m trying to understand:
----------begin_max5_patcher---------- 1981.3ocyZssijhaF95dk12AqJ4hbnBxGAbzpczHkaxSPtXypVzf6p7NTXVv 0TcOqx7rGaL0gtFnKSObnmVCTXLle+w+2+I6+3G+g6V8f5IQ8Jv+D7Kf6t6O LsbWSa1Vt6XC2sZWxSo4I0McbUpZ2NQgd051apEOoatw+YahFHqA5slCp85x 85O7eK92sM7Xk322KJRedMnbaRsXMnX+tGDU.0ifsIU6TExz50fjck4R89Ly 8SJdF7IYQlsG0xB8VQ8y0lQ7illNr8YPlRTCjZP51jhMB6c9WurEvChzj80B 6.XdZyXq1WnsWUIx.xhlFKySJDe.b7Q0UIoeBjXegaxM2U9jH+CfOB1ppjeQ UnSxApJvmEUZYp424RyCeBJrWkZeGV7fcrUy7TVjKzMvG5XqxrFPS8vu8OnQ qtnuFj6XmgGa9QyatV9EQyHfCN0dYhNcqQRuuRjpceFQPl49.JC1bJ11aPjo Mvud4nUjrqYzV8wJYR9pl67+9wevd1bZs2ZC6D00IaDeq1PUhV.fq5DDvc.B XTOfvIDqrRTaT7RzRUwESXNIHDEFEZlr1oJr8vKmtm.OT.iyPwQGuo6EoetT 3FsUqN+fcftb3o2As4HJdpPVG8Xk2ZQn3d.P7szh9FLPZo2fUOXXQuNbPHNP n4nSiCCmL.QbvLO+VMs+N.4uZFicK0rAgRuJ5f3MTQh6HNfMknydiQ482Paw J7sV6OKDWBN3d.GxaUEp4+uJHgQmoTHXGpPRsXWqPuJ84zbwWsC5Z6Ack77E VuJppyWaeEec07pJ1JCCwtGkOHExaZ+pVtovL0dcZK5BEyP7xPacee5DmHcg SwK.NEcANQCWFb5nNu2JTz4Gnv3KAJ5x.T0hbi.YoeztQKVWdMiFM+AdATNq cQtijkAnblM8k3gfKf9jCflGhWco48VopSUkCgmcyf16Id03XWzijtiVs+nr HtHNIvy9JO+X0pBUC9O2vP3MggNBLh0674MK9hujkjdVt+bR0I8ij8Z0VQd4 8ldLfDR32ZlkqRsJxWlhRGe737F023PWZYGO9cLU6iW+2LAdDf8eFRV.l8Q3 f5XAwSK095ZUzmVw8MX325QQmToAI6yjptywG6c1YDzfxw+ZrtKjj4.OdS7a jlKHjoBIKSJD4chiMfzAYwgL0g6eY25FUdXSpJWU0ZJng6e4gtyLA9FLyPXH G0CcQxErWTJjGTUYhpW7oz0zEhHLfvwHVj0PczoegPQgznVI9MCqZ0lM4hAj j+sXrCOKUKijyC4z30.NM.yi3wbGo7H0b7qNjQpDUkf+7.xbGOtFq7GTPXbP DlDBwFsG5zVzmeSpCdrrdyd4.zInCpvO2FYtYN6NUCmur3SQpMOlvOoB8WNr UltEXHp62U7WG.bwFaKwXTTPbnQawnYPBC3jPJDYPlINt0dIW0ZUo+7JT3bR rPPy.DGFiIFnI7bgwlNJUuJP58UEf8k.sBjKq0hhAnCwGacHJw4qxkVP7DGW zi4Jib6+7ECGWSLl2ehmkXlhcXAl1WMlMoyVaBDuYrgA72C0hGiGW7x6Bxi4 j.DmX9aMHBGPPbDmubvVeUpQtwlpx.vSxBTChKfRNKHhRi3l38nj2YTS5hQM sN6ZW5M3BRNe8kfbPgXxlUWgmgOmmPZzzFbY+.kHIa.nzrFvPXX.iEFGyNEu vDGBdeFsrgl+65fcpOKElfVfl.fgCflFMtzTizb+tDC65IOCWOzUkMDZhKlp OkOrRsuHSj8h.ldQUAfALLmhvq67W8Uj.b7anHAsUjG611Dn1Ezl78k2auwb lI28Kne0e0FBdzKaDzjrBjCis.IJz7aTHjcb6LLekh6EPBbHPBYzyeyjfOIz 7O97BIuRcbM1WBFPgbYKP3QNdCGdNxnEZARsFlKEhO8UvCIU.LXHU.ejsJ2B b9toGLpYAwljgQqs6hoIE7FZgFIwuwJMNaA9RNmCtomxclm09gCddEZm63gI QmVRu2YIbsSnqT.7P1VJi7ZCcazygXM1PXKnkDWPUVSI9qJRwKbvct5EEQWH W3+TKnYeQ+L3m9S.iOcfrnbut1bYyNr8mG.ZN5N3IlNQwTLyVnwPb.kBg1p4 eJ1ukp30UpCCnx0zvIMXvKJcc3DW+wFW1GjEYpC2ZwBSR+zll7E5EUP2h7cq U3PUTmVIDE2JUg1LnXGccaO04Bj4F5lkJ95MWeyvZuwUvSsZeU5Q46XnIfKf +LQsVVzrYRtnWW0osxrrqlG6jYkJiq4S66y9+nMxxV3hHa1REdaYqYFfdmBb 17XGFxgQb2hnzDAxkWMNXp2P5fjZJjGPOtHqFe9HJGeV5aaXbvc1zLClQkB6 l04soTvaWgV2tfnqqnv3S8bbTXPdomuL3MJ1GgiF+dV33uiEND78LxQWFgyO NNaQDtq0l54ypcJPlegK1agiN+eVgdKb34G4ndKbyejPLl2B27SHXdEvCaYX q94ZcYh81Kb65HzmKgyK5.dY9nR7xDrsnbK.Wk5kJGZY7rh8xyJcYHDT3633 fwroQ3PTSlat80.qYUMZRCgQFqbKBmFwNJL.1tQClBwFMQhcyJ52tgJmB4lD 6skoEfe4kCmqseMW1z8i7yGpM81r0wQtMMDgd5p4VrW.aVPuqUx2meRaClS+ ew5lUNC -----------end_max5_patcher-----------
…any help is truly apreciated. Thanks!
I was fooling around with jit.peek~ for several days…
Tried different dimensions, besides (x,y), and they seem not to work…
I understand that the 1st two audio signals define the X and the Y of a single plane of the movie, but if one changes the phasor to other oscilator, it changes the sound.
What is happening, regarding DSP?
Is this a sum or multiplication os signals? What kind of synthesis is this?
you are still trying to impose some abstract meaning on the matrices and signals that might be causing your confusion. both the input (matrices) and the output (signals) to jit.peek~ are numbers.
if the input matrix is one or two dimensional, and one to four planes (as in the help file), it is easy to view that data as color information by plugging it into a jit.pwindow. but it doesn’t have to be constrained or interpreted that way.
the output is just a signal vector representation of the input. no frequency, no harmonics, no synthesis, just numbers directly pulled from the input matrix. whatever you do with that signal before sending it to your speakers (if that’s the intention) is up to you. in the help file, one row of one plane of a 2D 4 plane matrix is read by peek, multiplied, and played back.
check out Max5/examples/jitter-examples/audio/ for further examples. hope this helps.