Anthony Palomba

I want to explore augmented the idea of integrating Max and an augmented reality platform like Magic Leap.

Getting to know shy office mates and browsing through solar systems. You know, Wednesdays. Shot directly through Magic Leap technology on 10/14/15, without the use of special effects or compositing.

Magic Leap | Demos: Everyday Magic with Mixed Reality

Ideally it would be awesome to be able to create a jit.world with objects in it and send it to the Magic Leap device and see the jitter world around you. Or be able to place interactive musical interfaces in the augmented reality space. I also envision instruments like Reactable being shared by multiple users wearing a Magic Leap devices

https://www.youtube.com/watch?v=0h-RhyopUmc

My question for Cycling74 and developers is what are the ways that third party apps can connect to Max? Can you create send 3d objects or matrix data across TCP/IP to be rendered on the Magic Leap device? Likewise any interaction in the Magic Leap world would be conveyed to Max. Is this the way Mira does things on iOS or is there a better way to do this?

I want to explore augmented the idea of integrating Max and an augmented reality platform like Magic Leap.


Ideally it would be awesome to be able to create a jit.world with objects in it and send it to the Magic Leap device and see the jitter world around you. Or be able to place interactive musical interfaces in the augmented reality space. I also envision instruments like Reactable being shared by multiple users wearing a Magic Leap  devices 

https://www.youtube.com/watch?v=0h-RhyopUmc

My question for Cycling74 and developers is what are the ways that third party apps can connect to Max? Can you create send 3d objects or matrix data across TCP/IP to be rendered on the Magic Leap device? Likewise any interaction in the Magic Leap world would be conveyed to Max. Is this the way Mira does things on iOS or is there a better way to do this?


I want to explore augmented the idea of integrating Max and an augmented reality platform like Magic Leap.

 
Ideally it would be awesome to

experimenting-with-augmented-reality-and-max

Okay let me rephrase my question. What is the best way to send data from Max to another app (iOS, or VR Headset)?

OSC is the only thing i can think of (ha, i have been thinking of answering this here for days, but didn't because i don't know anything about VR or this particular platform you're using...) i've been learning Unreal4 lately, and prior to that dabbled in Unity, and to get data of any kind from Max to these two environs, it seems the 

 way, other than creating your own file-protocol and developing your own bridge between Max and the platform(or using some 3rd party stuff, that probably doesn't even work with 3D/CGI environs but deals more with streaming audio/video or a set frame-by-frame capture of something... with all the problems of dropout which accompany that type of system), is to send OSC... this probably means you wouldn't send the exact visual data, but 'specification data' for the platform to render something similar.

i don't know much about the current capabilities, though... i feel like the .OBJ/.DAE/.FBX file formats are actually small enough that it would be easy to send across a network, but i've not seen anything like this used anywhere(i think i probably don't understand how complex those objects can get, too: i do notice when creating face-groups to color different parts of an object differently, the size of a .dae file can increase, even though the polygon-count/shape was never changed).

👆all that to basically say, i have no idea 😂 

(but hopefully at least offered some food for thought and bumps the thread for others to chime in)

OSC is the only thing i can think of (ha, i have been thinking of answering this here for days, but didn't because i don't know anything about VR or this particular platform you're using...) i've been learning Unreal4 lately, and prior to that dabbled in Unity, and to get data of any kind from Max to these two environs, it seems the only way, other than creating your own file-protocol and developing your own bridge between Max and the platform(or using some 3rd party stuff, that probably doesn't even work with 3D/CGI environs but deals more with streaming audio/video or a set frame-by-frame capture of something... with all the problems of dropout which accompany that type of system), is to send OSC... this probably means you wouldn't send the exact visual data, but 'specification data' for the platform to render something similar.
 i don't know much about the current capabilities, though... i feel like the .OBJ/.DAE/.FBX file formats are actually small enough that it would be easy to send across a network, but i've not seen anything like this used anywhere(i think i probably don't understand how complex those objects can get, too: i do notice when creating face-groups to color different parts of an object differently, the size of a .dae file can increase, even though the polygon-count/shape was never changed).

👆all that to basically say, i have no idea 😂 
(but hopefully at least offered some food for thought and bumps the thread for others to chime in)

texture sharing via Syphon or Spout, and matrix sharing via 

 are also possibilities to explore for inter-app communication.

texture sharing via Syphon or Spout, and matrix sharing via NDI are also possibilities to explore for inter-app communication.

Thanks guys for feedback, I will research these options.

Experimenting with augmented reality and Max