Live spectral processing: patches for Expo '74 NYC 2011
These are 10 patches I prepared for the workshop “Live spectral processing” I gave at Expo ’74 in New York City on October 16th, 2011.
Includes 5 audio freeze patches, 4 phase vocoder patches, and a simple live machine-learning patch.
I love these patches. I've been spending some time with them and I have a question: What would I need to change if I wanted to sonify an arbitrary image using the basic structure of the 08-photo-pvoc patch? If I load an existing 1-plane spectrogram into the matrix I get mostly crackling noises. Is it because the phase plane is empty? Should I fill it with something? Perhaps it's a float32 translation problem?
Sorry for the noob question. I appreciate your work and it's really helping me understand FFTs
Thanks Zach. The patch is meant to work with a 2-plane matrix, float32 type; the most important is to keep the matrix height: it is the number of bins, i.e. half the FFT size.
As a first step to "sonify" an image, try to feed it to the "amplitude" plane (plane 0) of the "spectrum" matrix in the example, without changing the type/dim/planecount.
The "phase difference" plane (plane 1) can be filled with 0s, or with "noise" (random values).
To get started with a more simple template, you could get started with patch "3-record-play-speed-control" among the ones at https://cycling74.com/tools/charles-spectral-tutorials/
Amazing patches! Is is simple to change the sonogram from a floating window to one fixed to the patch? I tried the obvios... turning off @floating 1 but that just means it isn't the top window anymore.