Robert Hart

I am currently developing an application where I need to send data between a Hololens 2 and Max. Basically I send control information via OSC from the Hololens (Unity application) to my patch.

At the moment I'm looking for a good way to send Max's audio output to the HoloLens. Does anyone know a good solution for this?

In summary, I need a way to send my audio output over a local network where only the sender can run Max.

I would be happy if someone could help me there.

Hello everyone,

I am currently developing an application where I need to send data between a Hololens 2 and Max. Basically I send control information via OSC from the Hololens (Unity application) to my patch.

At the moment I'm looking for a good way to send Max's audio output to the HoloLens. Does anyone know a good solution for this?
In summary, I need a way to send my audio output over a local network where only the sender can run Max.
I would be happy if someone could help me there.
Many Thanks.


Hello everyone,

I am currently developing an application where I need to send data between a Hololens 2 and Max. Basically I send control i

send-audio-via-network-to-hololens-2-unity

HoloLens 2 features a Snapdragon 850 chip and a second-generation holographic image processor, each screen on the visor has a resolution equivalent to 2K, 5 microphones, spatial audio speakers, USBC port, Wi-Fi support and up to three hours.

HoloLens 2 features a Snapdragon 850 chip and a second-generation holographic image processor, each screen on the visor has a resolution equivalent to 2K, 5 microphones, spatial audio speakers, USBC port, Wi-Fi support and  up to three hours.
cookie clicker 

How's your work going? I'm also trying to send audio via network using unity. A few toolkits I found useful: 

Tho I found some latency issues from the sender side, may due to Holo's hardware affordance.

Happy to discuss with you if you are keen!

How's your work going? I'm also trying to send audio via network using unity. A few toolkits I found useful: 
- https://github.com/Iam1337/extOSC
- https://github.com/keijiro/OscJack

Happy to discuss with you if you are keen!
Cheers.

Unfortunately I haven't been very successful so far.

For the controls I do use extOSC. But I don't think this suits for audio transmission.

I managed to set up a WebRTC process that uses a virtual cable to capture the system audio/max output and send it to the lens via WebRTC and a local server. Unfortunately the received audio seems to be highly optimised for voice transmitting as one can hear a lot of processing for it. As I need to handle music files this was not an option.

I think I could have looked at the depth of the source code for the WebRTC implementation and eventually found a way to make it less processed, but for now I've replaced the process with rendering using a Unity Spatializer on the HoloLens itself.

However I'm still trying to implement that transmission part at some point because Max gives so much more control. 

Unfortunately I haven't been very successful so far.
For the controls I do use extOSC. But I don't think this suits for audio transmission.

I managed to set up a WebRTC process that uses a virtual cable to capture the system audio/max output and send it to the lens via WebRTC and a local server. Unfortunately the received audio seems to be highly optimised for voice transmitting as one can hear a lot of processing for it. As I need to handle music files this was not an option.

However I'm still trying to implement that transmission part at some point because Max gives so much more control. 
How is your progress?


Sorry for my late reply - I put this network project aside for a while since last post - now I'm back - happy to discuss and share audio/dsp dev issues in holos.

Just want to clarify - you want the audio generated from laptop Max send to holo in *real-time*? So that the audio can be played in holos directly ?

I reckon there is a huge different between sending a real-time generated audio to holo for playing, versus sending a sample( music files which you mentioned). This also implies very different technical issues.

Hey Robert,

Sorry for my late reply - I put this network project aside for a while since last post - now I'm back - happy to discuss and share audio/dsp dev issues in holos.

Just want to clarify - you want the audio generated from laptop Max send to holo in *real-time*? So that the audio can be played in holos directly ?


I reckon there is a huge different between sending a real-time generated audio to holo for playing,  versus sending a sample( music files which you mentioned). This also implies very different technical issues.

Cheers,
Alice



Hello there, I have potentially the same issue like Robert where I'm trying to generate audio in Max real-time and playback the audio in Unity. I'm wondering if either of you have a solution for this?

Send audio via network to Hololens 2 (Unity)