patch audio to visual
Hi everyone. I'm trying to create a project that focuses on the concept of individual uniqueness. I'd like to capture a voice (live) and visually produce a system of particles that can be moved by voice and hand movements. I'd also like the particles to have a different color palette for each frequency, to emphasize the concept of uniqueness. I'm a beginner and I'm having a hard time understanding how to do it. Does anyone know how I can do it? I can't share my patch so I'll post the screenshot
Hi IDK
For the capture a voice part, frequency analysis. So there is a lot to explore in FFT world. Not really beginner friendly but is worth the work.
For beginners you could try [fffb~] object and [peakamp~] for every band. Its CPU intensive but simpler to grasp. You are basically chopping in discrete frequency groups and getting their amplitude.
For a good introduction into the frequency domain: MSP Analysis Tutorial 4: Signal Processing with pfft~ | Cycling '74 Documentation
Hand movemnt is a whole different problem :)
In Package Manager, download and experiment with cv.jit for hand motion - specifically cv.jit.centroids
Thank you so much. I'll try what you say, although I'm still not sure how to connect pfft to jit to move objects. I was also wondering how I can make the color change based on the frequency.