Procedural Audio and Binauralisation Using Max/MSP and the Unity3D Game Engine


Despite the reliance on procedurally generated (aka “generative”) audio techniques in early video game consoles, the nearly two-decades that have passed since the introduction of effective playback of recorded samples have seen few implementations of procedural audio in commercially released titles. The growing scale of modern games requires that we re-evaluate the potential for procedural audio to increase sound effect variation and decrease usage of memory resources. This paper describes the creation of procedural audio models for use within a modern, shooter-style video game setting. Max/MSP was used to create the models, which are triggered by a Unity3D-powered demo game environment, called “Bootcamp”, which has been altered to communicate with Max/MSP. In order to localise sounds, an audio binauralisation engine has been developed based largely on the principles of Lord Rayleigh’s Duplex Theory, in addition to simple front-to-back localisation. The result is a complete overhaul of the original demo game environment’s sound design, and a convincingly realistic one at that. My hope is that the features of this system can be integrated into a commercially released video game title, either by native integration of Pd into a game’s sound engine, or by hosting Pd within Wwise via a VST-style plugin.


All of the sound in the project and all of the panning/binauralisation is done in Max/MSP


More Links


Feb 16 2012 | 7:14 am

Hi,

I am trying to use max alongside unity but cant seem to get them to communicate, i am just wonder how you managed to do this?

Feb 16 2012 | 3:16 pm

I sent you an email about the max-unity interoperability toolkit. Let me know if you have trouble working with their examples!

Feb 16 2012 | 3:20 pm

And, in case anyone is interested in downloading the project, use the links below (inlcudes full dissertation text):

PC Version:
http://www.fileswap.com/dl/97j92M2B1B/WHKDissertation_PC.rar.html

Mac Version (Unity installer not included, too big :-P):
http://www.fileswap.com/dl/6P0QrhAQ07/WHKDissertation_Mac.rar.html

May 12 2012 | 1:14 am

Can’t wait to dig into this project. My dissertation is next year, and this could really help me decide on whether I’m moving in the right direction!

Feb 20 2013 | 1:42 pm

Hi there

I’m an audio tech student from Glasgow. I’m currently doing my dissertation, this is extremely interesting and I would love to see the code and max patch that you used as a guide?

Regards

Wkdside

Feb 20 2013 | 4:47 pm

Thanks for your interest! Please refer to the links I posted in another comment. These download links contain everything I created during the project.


Joe
Feb 23 2013 | 6:44 am

Hello!

Again, like a lot of people I am very impressed. About to start my masters degree dissertation which will be looking at Procedural Audio in games. Just a quick question, the link you have provided for download, does that include the max/msp patch? Or have you made a standalone application within unity? Hope to hear from you soon and would really like to chat more with you William

All the best

Joe

Feb 25 2013 | 9:10 am

The download link contains everything; standalone app, max patches, unity scripts, everything. Follow my YouTube links to find my username. My email is my YouTube username + at gmail dot com

Oct 30 2014 | 9:36 pm

Hey Joe

I too am doing a Masters Degree in procedural audio. or though I’m focusing on Composition rather than SFX.

I was wondering how did you get on? I would like to see what you achieved.

Nov 04 2014 | 9:25 am

I would be interested too

Feb 09 2015 | 1:03 pm

hello. i´m a student from portugal.
can you please reupload the project.
PC Version:
http://www.fileswap.com/dl/97j92M2B1B/WHKDissertation_PC.rar.html
thank you very much
ricardosalazar@live.com.pt

Jun 05 2015 | 7:48 am

Would be really nice if you can upload the project again, it seems to be broken.

Thanks in advance!

Jan 21 2016 | 2:08 pm

Hi there,

Would be fantastic if you would be willing to re-up the OS X version of this!

Great work!

Thanks

rjshemming@gmail.com

Nov 21 2016 | 3:16 pm

Hi Hunter,

This is amazing – curious if I might be able to find your dissertation elsewhere online? The above links don’t work (for me, at least) Also curious if the interoperability-toolkit still works in Max 7 with Unity 3d. I’m teaching a course at USC and would love to have students use this. Thanks very much,

Kate
kgsoundie@gmail.com

Nov 21 2016 | 3:59 pm

Awesome Job.

Nov 22 2016 | 8:11 am

Links are down can you repost them?

Viewing 16 posts - 1 through 16 (of 16 total)

Explore More

Subscribe to the Cycling ’74 Weekly Newsletter

Let us tell you about notable Max projects, obscure facts, and creative media artists of all kinds.

* indicates required