Route Audio/Master Track to MIDI device for MIDI & Lightshow Visualisation

Hi everyone!

I've spent the last 7 years developing Max devices solely focused on amplifying what you can do using MIDI inside Ableton to create Light-shows and stage visuals, and I've hit a roadblock...

I am attempting to make a max for live device that can listen to the audio flowing from the master track in Ableton, react to it, and generate MIDI visuals that are then sent out to hardware devices, as well as jitter devices that react and simulate these MIDI visuals, but have an ability to record the jitter feed where the visual have synced audio to the visuals that i am recording.

Currently i am achieving this by using the plugsend~ object on a secondary device to send the audio from the Master track (for example) into my MIDI device so i can sync the audio with the recorded MIDI visuals.

I am seeking a new approach, where the entire device is contained within itself, no secondary device needed, the MIDI device is able to listen to audio elsewhere in my Ableton set, and sync the recorded visuals to the recorded audio.

I've been tinkering with the ability to listen to the audio from other tracks, and have discovered that this is possible if the device type is set to audio. However, this is not an option, as all of my visuals respond to MIDI flowing through the MIDI device. I could absolutely create a second device to transmit the MIDI but then we're in the same boat, two devices...

It's a little bit out there, i know, but if there is any way of achieving the ability to, within a MIDI device, listen to the signal from an audio track, without the use of a secondary device, that would be absolutely perfect.

If anyone knows a way of accomplishing this, that would be super helpful. Always happy to provide more context if necessary!

Thanks a bunch :)

Charlie