Convert an image into music

    Nov 04 2009 | 2:41 am
    I want to create a patch that will allow me to accurately generate music based on an image, and when the music is played in a sonograph the spectrogram will reveal the image. I have never really delved too deep into using FFT and STFT beyond the MSP tutorials, and have absolutely no experience using FFT in Jitter. I'm sure there are many people here who have done this type of thing before, so I was wondering if anybody would mind giving me a quick rundown of what I need to do, point me in the right direction, suggest good resources to use etc.
    I really appreciate anyones help, and will share the patch once it's complete.
    Here is an example of Venetian Snares - "Look" when played through a sonograph, Aphex Twin did something similar with the track "Mathematical Equation" from Windowlicker.

    • Nov 04 2009 | 9:12 am
      I think you should look for metasynth. I guess that Richard did it that way.
    • Nov 04 2009 | 9:21 am
      it was right at the end, when 'windowlicker' is teetering out, it does this squelchy, squealing sound. that was also done with metasynth.
      great sound...
    • Nov 09 2009 | 9:51 pm
      Hi guys,
      I'm still trying to do this, for the purposes of learning. Can you use jit.buffer in a pfft~, and use the jit.buffer to compute as audio, maybe through converting a char matrix to float32?
    • May 24 2011 | 12:13 pm
      Hey Blake,
      Any luck with this?
      I had a fiddle around but can't seem to get it working.
    • Jun 10 2011 | 10:34 am
      Hi Guys
      This might be a start - one of Baz's youtube patch-a-days: