FFT-based binaural panner

    The FFT-based binaural panner is not an external, but rather a project that consists of a couple of Max patches and 43 pairs of HRTF-subject files to be read by jit.matrix~.
    It was created in 2011 as part of a thesis on the possibilities of binaural synthesis in combination with head-tracking, in an aesthetic/experience-oriented context. In the thesis project, the FFT-based binaural panner is a small, but essential, part of a larger construction in Max, involving sensor-based head-tracking, room simulation, configurable sound- and listener positions etc..
    The project is inspired by other Max projects such as Head in Space (http://sites.google.com/site/dariopizzamiglio/projects/head-in-space) and Binaural Tools (http://www.ece.ucdavis.edu/binaural/binaural_tools.html). The FFT-based binaural panner was created to reduce the substantial load on the cpu that comes with convolution in the time-domain. It uses pfft~ to perform an equivalent but 'cheaper' mutliplying process in the frequency-domain.
    The panner uses the impulse responses from the CIPIC HRTF database (http://interface.cipic.ucdavis.edu/sound/hrtf.html) but in a frequency-domain and interpolated version.
    The project also includes a HRTFSubjectMatcher sub patch, which relies on a java external ('HRTFSubjectMatcher.class'). The HRTFSubjectMatcher tries to match the entered listener measurements with the subjects in the CIPIC database. However it must be mentioned that it is by no means scientifically valid, but might serve at a rudimentary tool for selecting an appropriate HRTF file set.
    Best regards Jakob Hougaard Andersen

    • Eli
      Dec 12 2011 | 8:58 am
      Fantastic idea!
    • hthaw's icon
      hthaw's icon
      Sep 29 2012 | 7:11 pm
      Hey Jacob - Thanks for the great patch.. The javascript for the DirectionAndDistanceHandler seems a bit off to me - I was wondering if anyone else had a similar problem - the Left Ear Gain is in whole numbers, usually >50, whereas the other stuff seems to be scaling proportionately under 1.
    • Jakob Hougaard Andersen's icon
      Jakob Hougaard Andersen's icon
      Jakob Hougaard Andersen
      Oct 03 2012 | 9:38 am
      Hi m. Tanks for your comment. You are perfectly right - there is a problem. It is because I had included an earlier version of the DirectionAndDistanceHandler, where the second outlet was elevation for the panner. In the correct verson azimuth and elevation comes out as a list from the first outlet. I am sorry for this mistake, but now it should have been corrected. It is important to overwrite or delete the old DirectionAndDistanceHandler.class file, so that Max uses the new one instead. Be shure to write again, if there are other bugs. Best regards Jakob
    • kaushik sunder's icon
      kaushik sunder's icon
      kaushik sunder
      Jun 19 2015 | 11:34 pm
      Hi Jacob,
      Thank you for this wonderful tool. Could you let me know how do you convert the CIPIC database hrtf files in .mat form to .jxf format? . That would be really helpful.
      Regards, Kaushik
    • Roman Thilenius's icon
      Roman Thilenius's icon
      Roman Thilenius
      Jun 20 2015 | 12:16 pm
      those hrtf files used to be pcm audio at first. to convert the to a fft filter setting you would just play a spike or noise through them.
    • Franky Redente's icon
      Franky Redente's icon
      Franky Redente
      Oct 25 2015 | 5:10 pm
      Hi Jakob and everyone else.. I am using this patch for a VR test using the oculus rift - leap motion. I have implemented the [p virtualSoundPositioning] but I have some problems.. i think.
      The 3D world I have build x = left and right, y = elevation and z = depth (front - back) In this patch x = left (0)and right(10) position, y = front (10) - back(0) z = elevation 0 to 5 m
      In order to make it work.. shell i just swap the my coordinates around, e.g. y becomes z ? Also I have added the listenerRot ( using the Oculus quat values do i need I need to convert anything for that?
      The problems I am having: When I navigate around the object (via the Oculus position) and i go around the left side of the object, i hear the sound in the left ear rather then the right ear (butt the object is on my right). When I move the object, Oculus remains still, the panning seems to be correct. When I move my head up and down the sounds goes right (look up) and left (look down).
      I have tried to send the coordinates to the nodes..so I can sew what happen but seems I can only control one node at the time ??
      Please could you help me on this, just to check if I am doing something wrong.
      Thank you guys. Best F
    • Franky Redente's icon
      Franky Redente's icon
      Franky Redente
      Oct 25 2015 | 6:13 pm
      re quat : here what the patch says: ... optional listener rotation is given with unit quaternions with the scalar part as first argument
      What I did is send the Oculus quat via [pack listenerRot f f f f] sent to [ s toDirectionAndDistanceHandler1] . I am not sure what "the scalar part as first argument" is ? please help.
      thank you.
    • Jakob Hougaard Andersen's icon
      Jakob Hougaard Andersen's icon
      Jakob Hougaard Andersen
      Dec 02 2015 | 12:30 pm
      The DirectionAndDistanceHandler mxj object works with the x-y axes being the horizontal plane and the z axis is up. In many (most) 3D tools the y and z axes are opposite, so that y is up and z is forward. I don't know why I built it the other way around, but that is how it works. So you might have to swap some of the elements of the quaternions and positions coming from other '3D tools' such as Occulus in order to make it work correctly. I made a test where I sent rotation quaternion values from Unity (game engine) to Max Msp to be used in the DirectionAndDistanceHandler. And here I had to swap the y and z values to make it work – this makes quite good sense since in Unity, z is forward and y is up. So the order of values in the sent quaternion would be w x z y. And if I were to send position coordinates as well, the order would naturally be x z y. Best regards Jakob
    • Marte Roel's icon
      Marte Roel's icon
      Marte Roel
      Aug 22 2016 | 4:02 pm
      For anyone using this on Windows, I managed to have it work by installing Java 3D besides the Java Runtime, you can find it here: https://java3d.java.net/binary-builds.html
      I tested this on Windows 8.1
    • michel8's icon
      michel8's icon
      Apr 15 2018 | 5:54 pm
      Great Panner, at OSX Max 64bit it works perfectly for virtual sound psitioning! I will use it with Oculus.
      But on Windows 10 64bit and Max7.5.3 64bit, im struggling with folowing Java error! The Java 3D which Marte Roel recommended is off. So I install also the java3d-1_5_1-windows-i586 at http://www.oracle.com/technetwork/articles/javase/index-jsp-138252.html Waht could I do to get it run on Windows?? Thanks!
      Max Console: mxj: could not find Java 2 Runtime Environment. Error loading: (mxj) mxj_platform_init failed. Could not initialize the Java Runtime Environment. Please check your Java installation. http://java.sun.com Unable to create JVM
      The Java version at Command Prompt give me: java version "10" 2018-03-20 Java(TM) SE Runtime Environment 18.3 (build 10+46) Java HotSpot(TM) 64-Bit Server VM 18.3 (build 10+46, mixed mode)
    • michel8's icon
      michel8's icon
      Apr 16 2018 | 7:13 pm
      Update: I find out that also the standart "mxj net.udp.send" wasn't running. After install the offline Java 64bit https://www.java.com/en/download/manual.jsp i" mxj net.udp.send" was working. But the fft-panner still not! I try also with Max6 where its the same.
      Now the Max Consol shows diffrent. The bold one is the error message: MXJ System CLASSPATH: C:\Program Files\Cycling '74\Max 7\resources\packages\max-mxj\java-classes\lib\jitter.jar C:\Program Files\Cycling '74\Max 7\resources\packages\max-mxj\java-classes\lib\jode-1.1.2-pre-embedded.jar C:\Program Files\Cycling '74\Max 7\resources\packages\max-mxj\java-classes\lib\max.jar IVirtual Machine boot MXJClassloader CLASSPATH: C:\Program Files\Cycling '74\Max 7\resources\packages\max-mxj\java-classes\classes\ C:\Program Files\Cycling '74\Max 7\resources\packages\max-mxj\java-classes\ Jitter Java support installed java.lang.NoClassDefFoundError: javax/vecmath/Tuple3f Caused by: java.lang.ClassNotFoundException: javax.vecmath.Tuple3f at com.cycling74.max.MXJClassLoaderImpl.lookupClassData(MXJClassLoaderImpl.java:219) at com.cycling74.max.MXJClassLoaderImpl.doLoadClass(MXJClassLoaderImpl.java:111) at com.cycling74.max.MXJClassLoaderImpl.loadClass(MXJClassLoaderImpl.java:89) at java.lang.ClassLoader.loadClass(Unknown Source) (mxj) unable to alloc instance of DirectionAndDistanceHandler HRTFSubjectMatcher: All values cleared Like you wrote, I put the 'DirectionAndDistanceHandler.class' and 'HRTFSubjectMatcher.class' in to the C:\Program Files\Cycling '74\Max 7\resources\packages\max-mxj\java-classes but no success! And unfortunatly the https://java3d.java.net site is close, so what can I do?
    • michel8's icon
      michel8's icon
      Apr 16 2018 | 8:39 pm
      Update 2: After copy also the 'vecmath.jar' in to the C:\Program Files\Cycling '74\Max 7\resources\packages\max-mxj\java-classes it works at Win10 Max7 64bit! Hope its not a problem to copy a .jar from x86 to 64bit?
    • Mo Krates's icon
      Mo Krates's icon
      Mo Krates
      Jun 06 2018 | 3:13 pm
      where did you get the vecmath.jar file? because I have the same problem. Also "unable to alloc instance of DirectionAndDistanceHandler" error message
    • Jack Sheppard's icon
      Jack Sheppard's icon
      Jack Sheppard
      Feb 25 2020 | 2:36 pm
      Hello there, could anybody tell me if this thread is still active? I need some help getting this max patch started and could do with any help.
      Thank you