MUSIC RECOGNITION

Abraham Gomez-Delgado's icon

Hello,

I am trying to take music from a vinyl record and have the audio recognized and matched causing it to sync to a digital video in real-time. I want to be able to put the needle anywhere on the record and have the video go to that exact place in the video too. The sync has to be very precise. I don't want to use timecode vinyl. I need to use just regular music records. I am initially trying to do this for a specific vinyl of my own music and a specific video that goes with the music.
I am more of a jitter person from way back in the day and have been getting back into max recently but extremely rusty.

Any advice or direction on how to achieve this would be greatly appreciated.

Gracias

brendan mccloskey's icon

Hi
my first thoughts, if you cannot use timecode, involve remote tracking of the position of the tonearm (?) or stylus. Without using additional software, I guess you could use a webcam into Max, and place a coloured blob on the stylus cartridge for colour tracking, which you could convert to position data. All vinyl LPs will have a uniform distance between the tonearm at rest, and the centre spindle. But you might not get the resolution you need with blob detection/tracking.. My own personal (simplest) approach would be to use an infrared range finder

and an Arduino.

But that's not a quick fix if you're not familiar with Arduino.

HTH

Brendan

Abraham Gomez-Delgado's icon

Thank you so much. I will check these possibilities out.

Abraham Gomez-Delgado's icon

I just had thought. If I were to have printed, along with the music, some kind of audio markers that were above the 20Khz range through out the record and only had max listen to that frequency range would that possibly work? If so, does anyone have any idea what the audio markers would be as far as having a unique code that would tell max where in the record the needle would be on? In other words, would the unique audio markers be some kind of morse code like thing or...?

Floating Point's icon

nice idea, but if you have a 20 to 20khz modulator for some sort of encoded signal, the actual demodulated signal would be below 20Kz. The ear would naturally 'demodulate' this itself, and would bleed into the sonic range, causing distortion. If you needed frame-accurate resolution, say 1/30th second, over a length of a recording, say 20 mins, thats 30*60*20 = 36000 discrete locations, or 16-bit resolution required. If the encoding frequency was 24khz, the ear would hear a signal with a fundamental frequency down to 2400/16= 1500 hz. Even if you tried some sort of analog encoding scheme, such as fm, you'd need a bandwidth of at least 60khz for this scenario, to keep it out of audio range. Someone please correct me if I'm wrong...

Floating Point's icon

edit: "20 to 20khz modulator" should read: "20khz to 24khz modulator" (ie modulator somewhere just above hearing range)