Seth Kranzler

I'm working on a patch which records two buffers concurrently - one audio and one video. These are around 1 - 2 seconds long, and the patch then shuffles the audio buffer and plays it back, sending frame cues to the video buffer on where to play. I am slowing down the audio at some points so I need to record higher frame rate (around 60fps) and in order to do this on a budget I've been using a ps3 eye and this 

I've followed the subtex.3d.maxpat example to try and keep things on the GPU. I modified the shader to pass texture data through which was a bit hacky. I know I am limited on texture memory but I'm not sure what other option I have - originally I used the built in macbook camera and did it all CPU side and the framerate would always drop drastically, which was bad news for audio-video sync. I would like to move from a tiled subtexture to some sort of array of textures. I have some experience with shader editing, just hoping someone can point me in the right direction. Right now I think my problem area is the jit,matrix - which I need because jit.gl.texture won't allow me to feed in syphon data directly.

Would appreciate some tips on how to achieve this! 

I'm working on a patch which records two buffers concurrently - one audio and one video. These are around 1 - 2 seconds long, and the patch then shuffles the audio buffer and plays it back, sending frame cues to the video buffer on where to play. I am slowing down the audio at some points so I need to record higher frame rate (around 60fps) and in order to do this on a budget I've been using a ps3 eye and this ps3 eye to syphon  open frameworks app.

I've followed the subtex.3d.maxpat example to try and keep things on the GPU. I modified the shader to pass texture data through which was a bit hacky. I know I am limited on texture memory but I'm not sure what other option I have - originally I used the built in macbook camera and did it all CPU side and the framerate would always drop drastically, which was bad news for audio-video sync. I would like to move from a tiled subtexture to some sort of array of textures. I have some experience with shader editing, just hoping someone can point me in the right direction. Right now I think my problem area is the jit,matrix - which I need because jit.gl.texture won't allow me to feed in syphon data directly. 

Would appreciate some tips on how to achieve this! 


performant-3d-texture-recording-and-playback-am-i-doing-this-right

hi seth. yes, more than likely the conversion from texture to matrix is what's slowing down your patch. i would not recommend this technique for a texture bank. instead take a look at the attached files, which demonstrates how to create a simple texture bank using poly~.

This seems to be working pretty well - not quite as performant as I had hoped but I think at this point its more of a computer limitation.

Performant 3D texture recording and playback // am I doing this right?