irvn

color-to-sound-iv

I don't understand what you have done from your descrition. Could you please put more

Do you want me to add instructions on the patch itself, or email you?

I would prefer both, as I need to get user feedback for a demo this summer ..

Do you want me to add instructions on the patch itself, or email you?
I would prefer both, as I need to get user feedback for a demo this summer ..


try this .. this is a simplified, luminance (brightness) only generator, which requires you to set the MIDI instrument number.

NO channel needed if using the internal synth.

It starts on note 24, up to 96, with inverse velocity as a quasi-loudness contour.

___________________________________________

It has extra message displays for troubleshooting .. they're fun to see .

If this helps, i'll revise the color patch as well..

try this .. this is a simplified, luminance (brightness) only generator, which requires you to set the MIDI instrument number.
NO channel needed if using the internal synth.
It starts on note 24, up to 96, with inverse velocity as a quasi-loudness contour. 

It has extra message displays for troubleshooting .. they're fun to see .
If this helps, i'll revise the color patch as well..


Hey, could you explain more what you did here? I'm in progress of trying to link timbre and brightness, would appreciate if you could point out some suggestions/help

suckah takes the mouse position and returns the R G B values in the range of zero to one each.

For brightness just add them together and scale it to either generate a frequency & volume or as I did, a MIDI note number and velocity ...

I don't know about timbre: if your synth patch can use the mod wheel to increase the filter cutoff, or a FM8/;DX7 kind of sound which let you us the mod whee/breath controller to affect the operators..

If you notice thee is a object which has a conditional expression similar to "if ( $1 && $2 ..." which you could use to generate the MIDI controller data

Note also I have used both internal synths like the Native Instruments FM-8 and Massive,

and external ones, including a DX-7 even~!

Ask more if you want .. i am developing this as a performance tool, and need the help

basically is uses the "suckah"  object:
 suckah takes the mouse position and returns the R G B values in the range of zero to one each.
For brightness just add them together and scale it to either generate a frequency & volume or as I did, a MIDI note number and velocity ...
I don't know about timbre:  if your synth patch can use the mod wheel to increase the filter cutoff, or a FM8/;DX7 kind of sound which let you us the mod whee/breath controller to affect the operators..
If you notice thee is a object which has a conditional expression similar to "if ( $1 && $2 ..." which you could use to generate the MIDI  controller data

Note also I have used both internal synths like the Native Instruments FM-8 and Massive,
and external ones, including a DX-7 even~!
I don't know if this helps ..
Ask more if you want .. i am developing this as a performance tool, and need the help


Hey thanks for your reply, I've looked at your patch you posted here, I played around with, I'm trying to understand what you did here:

I'm not sure I understand why you multiply 24 there?

Also, I'm trying to develop a sonification where I could translate colours into sounds for visually impaired. I've only managed to do a simple one but that's just taking average of rgb value of each pixel (I put it in 8X8 matrix and go through the image left to right and top to bottom) which gives me the brightness and I mapped it pitch. But that's just brightness, I was wondering what's the best way to map colour hues? I've tried to do it where I read an image and and then do jit.rgb2hsl and then I get the hue value and somehow connect it a carrier frequency of a fm synth but I dont think that's a right way or something is wrong with how I get the hue value because sometimes it doesnt make any sound or even sounds unpleasant. I read in one of the tutorials where modulation index controls the timbre, but I'm not sure.

Also, I'm trying to develop a sonification where I could translate colours  into sounds for visually impaired. I've only managed to do a simple one but that's just taking average of rgb value of each pixel (I put it in 8X8 matrix and go through the image left to right and top to bottom) which gives me the brightness and I mapped it pitch. But that's just brightness, I was wondering what's the best way to map colour hues? I've tried to do it where I read an image and and then do jit.rgb2hsl and then I get the hue value and somehow connect it a carrier frequency of a fm synth but I dont think that's a right way or something is wrong with how I get the hue value because sometimes it doesnt make any sound or even sounds unpleasant. I read in one of the tutorials where modulation index controls the timbre, but I'm not sure.


My patch divided the pixel into RGB, CYM and luminance.. that's nine different possible tones, plus pitch and volume & timbre.

I have yet to find one that is intelligible

i thought to do a controlled study with blind & sighted people .. not tool much ethical concerns.

My tool requires an operator moving the mouse over the already displayed image -- reading an image and then scanning it, creating literally a musical composition would be nice

Multiplying by 24.. or whatever .. is used to scale the pitch. I didn't want to use anything lower than a contra C (~32Hz) or higher than 2 kHz

Your motivation is similar to mine
My patch divided the pixel into RGB, CYM and luminance.. that's nine different possible tones, plus pitch and volume & timbre.
I have yet to find one that is intelligible
i thought to do a controlled study with blind & sighted people .. not tool much ethical concerns.
My tool requires an operator moving the mouse over the already displayed image -- reading an image and then scanning it, creating literally a musical composition would be nice
Multiplying by 24.. or whatever  .. is used to scale the pitch.  I didn't want to use anything lower than a contra C (~32Hz) or higher than 2 kHz
MIDI Notes 24 - 96 

What I meant by "tones" is different "programs" on a synth, like flute, organ, sitar, all on different MIDI channels:

for each there is pitch & volume (velocity) plus velocity controlled parameters like filter cutoff & vibrato

I didn't try to add mod wheel/pitch bend/aftertouch

What I meant by "tones" is different  "programs" on a synth, like flute, organ, sitar, all on different MIDI channels:
for each there is pitch & volume (velocity) plus velocity controlled parameters like filter cutoff & vibrato
I didn't try to add mod wheel/pitch bend/aftertouch


Oh yes, I know how to implement different midi channels.. for example this is just different types of drums:

For one of the patches I played around, I could change the midi instrument to piano or guitar or flute. I calculated the average rgb and linked the result into makenote pitch and constant velocity - loadmess 100 for example. But do you mean that I should have a different instrument for each r g b ?

I'm still unsure of timbre and how to implement it. I tried making 12 oscillators..so I mix 12 harmonically-related sine tones and that is to try different timbres. I then link each R , G, B values to a set of that oscillators. so each colour has 12 oscillators linked to it.

Oh yes,  I know how to implement different midi channels.. for example this is just different types of drums:

I'm still unsure of timbre and how to implement it. I tried making 12 oscillators..so I mix 12 harmonically-related sine tones and that is to try different timbres. I then link each R , G,  B  values to a set of that oscillators. so each colour has 12 oscillators linked to it.


Not really sure about this - "velocity controlled parameters like filter cutoff & vibrato"

Not really sure about this - "velocity controlled parameters like filter cutoff & vibrato"
Using line~ or lores~?


I've been trying to figure how to have different midi instrument for each colour I have - RGB

and this is linked to each one of - r, g, b

but I can only use one instrument at a time. If I firstly set r to piano , then g to flute and lastly b to harp. only the last one that I set will sound (in this case harp)and the others will not make any sound. I can't figure out why this is happening? I want all three types of instruments to make sound.

I can't figure out to have three sounds altogether. Any idea?

Also,
I've been trying to figure how to have different midi instrument for each colour I have - RGB
so I have something like this:
and this is linked to each one of - r, g, b
but I can only use one instrument at a time. If I firstly set r to piano , then g to flute and lastly b to harp. only the last one that I set will sound (in this case harp)and the others will not make any sound. I can't figure out why this is happening? I want all three types of instruments to make sound.
I can't figure out to have three sounds altogether. Any idea?


Apologies, that was pasted in wrong format.

Color to Sound IV

16 May 2012

Colorado Springs