How can I use video input to control a MIDI device?

thingfish's icon

Being relatively new to the awe-inspiring power of Max/MSP/Jitter, I humbly request someone's assistance with this.

I need to do something simple: I just want to take a video input, and convert the difference in pixel activity into a MIDI signal - something that I can then assign to a number of MIDI note values, triggering specified tracks in Ableton (I do have MAX for Live, as well as the full suite).

I've searched high and low with no clear (read: entry-level learning curve!) resource as to how I might accomplish this.

This must be easier than I'm making it. Any suggestions would be most appreciated!

Cheers
TF

Rob Ramirez's icon

i'm not sure why you think this should be so simple. video analysis is a complicated task.
fortunately you have Jitter to help you out.

i believe what you are describing is called "frame differencing". searching the forum for this term should yield much information.

andrew benson's excellent article will also be helpful:
https://cycling74.com/tutorials/making-connections-camera-data/

however, none of this information will be very useful to you until you've worked through the max and jitter tutorials.

thingfish's icon

Ah, yes, 'frame differencing' - that's the one.

My long journey of tutorials began with Baz Tutorials on YouTube - one of which was 'Sound controlled by video'

I only thought it was simple in comparison to more advanced techniques I imagine are possible with Jitter, perhaps - I don't know - tracking points from video input to control oscillator behavior or something to that effect...

I worked through a patcher that can control audio through frame differencing, I just want to find out how to convert that signal to a discreet range of MIDI values.

Thanks for the link, Rob - I appreciate the input!

Rob Ramirez's icon

I worked through a patcher that can control audio through frame differencing, I just want to find out how to convert that signal to a discreet range of MIDI values.

scale?

thingfish's icon

Yes, thanks - scale works nicely for my range issue.

I just need to convert numbers to MIDI notes, specifically, I realize.. seems to be my final hurdle.

hkerins's icon

this thread looks dead but im responding anyway because i am having a similar dilemma, using a homemade difference sensing patch. my current idea is to use scale to turn the frame difference numbers into a reasonable number of numbers (that sounded ridiculous) and then send each of those to a midiout object to control activity in Live.

anybody got a smarter solution?