The viewer is like one at a touristic sight (usually just some fancy binoculars).
I want to add some artistic and interactive value by adding video screens inside
(and maybe using a camera to re-use the real environment)
This way, I can control what they see, and add extra layers.
So, I need some kind of 3D world, where I can add a 360 shot (hopefully in a 3D sphere).
And I would like to have audio based on position of the point of interest.
So, if anyone has some tips or ideas where I can start, or what objects are going to be useful, tell me!
You should look into Jitter. You can create a sphere with jit.gl.gridshape then apply your 360 shot as a texture. Then you can rotate the sphere and according to rotation angle trigger some audio files. Happy maxing,