A Video Interview with Matt Wright, Musical Systems Designer
Education and Research
“Drawing” on Ornette Coleman: synthesis control using a graphics tablet.Watch Matt’s video
Interview created and produced by Sue Costabile for Cycling ’74.
“Drawing” on Ornette Coleman: synthesis control using a graphics tablet.Watch Matt’s video
Interview created and produced by Sue Costabile for Cycling ’74.
Controller workshop: From do-it-yourself tablas (with sponges!) to the Lemur.Watch Ali’s video
Interview created and produced by Sue Costabile for Cycling ’74.
Creating the personal instrument.Watch Christopher’s video
Interview created and produced by Sue Costabile for Cycling ’74.
On visual programming for visual media.Watch David’s video
Interview created and produced by Sue Costabile for Cycling ’74.
Controlling a Media Facade: The Bix Simulator and VJ software ES-X.Watch John’s video
Links
Interview created and produced by Sue Costabile for Cycling ’74.
Automated design and visuals.Watch Angela’s video
Interview created and produced by Sue Costabile for Cycling ’74.
Fabricating the interfaced machine.Watch Barney’s video
Links
Interview created and produced by Sue Costabile for Cycling ’74.
The Jamoma Project recently released version 0.2 of its modular framework for Max, MSP, and Jitter. Despite the low version number this software is actually quite mature, which years of development and experience forming the basis of the framework. Given that this is a significant release in Jamoma’s roadmap, I thought I would talk about both Jamoma and it’s development.
So, the first thing you are probably wondering about is what Jamoma is all about. Jamoma is a structural framework for creating, composing, and performing interactive music with Max. It does this by providing a set of guidelines for the construction of interchangeable, reusable, functional blocks (patches), called modules. In addition to the guidelines, the Jamoma Project has also produced an implementation of those guidelines.
Jamoma has been built around the advanced features in Max 4.5.5. Jamoma modules may encapsulate any type of functionality that can be performed by Max, MSP, Jitter, its components (such as Java or Javascript), or any third-party objects. It provides features such as fast DSP routines, XML-based preset storage, preset interpolation on both local and global layers, parameter mapping, and realtime CPU-load management.
The promises of any object-oriented environment is that components can be created, and then freely re-used. This is certainly true of Max as well. However, when a user tries to substitute a component of their patch, there is generally no standard to which the components (patches) are structured. This is actually a strength of Max, as it doesn’t impose its vision of how one should work on you.
Unfortunately, it is rare that patches can actually be interchanged between users (and auditioned) without a significant amount of work – work both learning the ins and outs of the new patch, and configuring the patch to work in the user’s own system of patches. This is the first of Jamoma’s primary goals: to provide a standard to which patches/modules are structured to allow for easy interchange and integration.
A second goal of Jamoma is to provide standard tools – that are virtually always required – with a minimum of time needed to set them up. As an example, audio modules will almost always benefit from a mute button, a bypass button, a gain control, signal level meters, etc. Video modules will benefit similarly from bypass, mute, and freeze controls as well as a preview pane. Jamoma provides templates and tools that incorporate these features with a minimal amount of setup time.
The third goal of Jamoma is provide hierarchical organization of the parameter space. Every module maintains its state, and provides a mechanism for reading and writing preset files specific to that module. Furthermore, global snapshots or presets may be created and maintained that apply to all instantiated modules via the use of Max’s standard pattrstorage object. This also provides a means to interpolate smoothly between presets to simplify complex transitions.
Jamoma grew out of initial research and development that was conducted as part of the Jade interactive performance environment. Jade is an application that hosts modules, which allows for script-based automation of these modules. Initial development on Jade began in early 2001 as a means to aid my own compositional work. It was released to the public at the end of 2002, which was followed by a significant update to version 1.1 in mid-2003. It was at this time that the great benefit of having modules directly within Max was realized – and Jamoma was born.
The Jamoma project was started as an Open Source project hosted on SourceForge. After some initial work activity died off until it was revived in March 2005 by myself and Trond Lossius.
A Jamoma Module is a Max Patch which has been structured according to a set of guidelines known as the JIG (Jamoma Interface Guidelines). Modules may either be embedded in a Max patch using the popular bpatcher method, or they may be included as simple Max objects. The screenshot shown here is an example of the two methods side-by-side. The filter module is one of a number of example modules included with Jamoma.
Every module will have one or more inlets and one or more outlets. The first inlet is used for receiving all commands to the module. Likewise, the first outlet is used to report the state of the module and return parameter values when they change. Additional inlets and outlets are the inputs and outputs for data streams that are to be processed or synthesized by the module. This includes audio, midi, and video signals.
This screenshot shows the filter module in context. In this example it is being used to filter the signal from MSP’s standard soundfile playback mechanism. Note the presence of a “bang” button connected to a Max send object called jmod.init. This mechanism is required, and provides a universal means to reset all modules that are loaded to their respective initial state.
The JIG specifies a variety of essential elements to ensure that modules are both interchangeable and compatible with each other. This includes the size(s) of the user interface, standard features, and reserved messages and syntax.
For example, every audio module is expected to implement the ‘gain’ parameter, which attenuates or boosts the output signal, specified in decibels. Each audio module should also implement the mute and bypass messages. No module may implement a message called bang, it is considered a reserved name due to its special nature in the Max environment.
Further, for all module parameters where it is feasible, the parameter should be ‘ramp enabled’. This means that when a second value is given to messages for the parameter, it will smoothly slide from its current value to the new value. This is aided by a set of tools for building modules that we will described later. An example of a ramping parameter is demonstrated in this screenshot.
One of the standard features of all modules is the ability to read and write presets in an XML file format. The facilities may be accessed as one of the standard Jamoma messages. Additionally, most Jamoma modules use standard facilities that provide a “module menu” in the upper left corner of the interface that include items for reading or writing a preset. (As a historical note, Jade was reading and writing presets in XML format prior to the release of pattrstorage, but it now uses pattrstorage to simplify and standardize the system).
The preset mechanism in these modules is built on the pattr system that was released as a part of Max version 4.5. This mechanism allows not only local preset reading and writing, as just demonstrated, but global access to the Jamoma parameter space through the standard pattrstorage object. This allows for the storage and recall of global presets and interpolation between those presets. The screenshot below shows an example of pattrstorage managing several modules.
Modules can be constructed from scratch following the guidelines published in the JIG, or they can use the extensive library of pre-made components that are a part of the standard Jamoma package.
Our screenshot shows the construction of a simple Jamoma module. This module consists of several key components:
One particulary time-saving feature for module developers is a built-in facility for producing module documentation based on the patch. Using a combination of patching and JavaScript developed by Trond Lossius, this allows you to send a message to a module and save an HTML pages with all of the information on how to use that module.
When a user begins with Max/MSP, they are presented with the paradigm of a blank document (see David Zicarelli’s CMJ article “How I Learned to Love a Program that Does Nothing). This proves to offer the user the ability to work with the software in any way that they like, offering no preconceived notions about how a module should be structured. This is both a blessing and a curse. While not limiting the user, it also provides no guidelines to help the user get started. It is our hope that Jamoma will be helpful for both long time users and beginners alike.
By providing a mechanism by which a patch must be structured, interchangeability can also be guaranteed. Many new Max users can thus be re-assured that any patch they develop will be able to be re-used. They will also find that they can use a variety of patches developed by others that conform to the JIG. Jamoma also encourages good structure and form for students beginning to use Max.
Jamoma is licensed under the terms of the LGPL, thus making it freely available for use in both commercial and non-commercial applications. This licensing was chosen for the purpose of helping to establish and encourage adoption of the system.
David Wessel is Professor of Music at the University of California, Berkeley where he directs the Center for New Music and Audio Technologies (CNMAT). Wessel worked at IRCAM between 1979 and 1988; his activities there included starting the department where Miller Puckette first began working on Max on a Macintosh. Since Wessel’s arrival in Berkeley over ten years ago, CNMAT has been actively involved in teaching Max/MSP as well as developing freely available Max-based software projects. In this 1999 interview with Gregory Taylor, Wessel talks about his musical background, his relationship with French composer and IRCAM founder Pierre Boulez, the origins of Max, and some perspectives on his current work.
I was raised in a kind of musical bath from the time I was fairly young. My mother brought music around to the house and I liked it and started playing in the grade school orchestra at the age of about 9 or 10. When I got into high school I played in a rock band, and became a jazz snob pretty early on, at about 17 – I just wanted to be a bebopper. All along, my father wanted me to be an engineer. I was very oriented towards that and loved it, too – model airplanes and mechanical drawings and all that stuff. But I was sort of being raised to become an engineer eventually.
So I had this technical orientation from the time I was very young and I had this musical thing going on in parallel. When I got out of high school I went to a jazz clinic that was held at Indiana University for a few weeks and I ended up getting a scholarship to the Berklee School of Music in Boston. I came home and was excited about the possibility of becoming a professional musician and my father and mother just freaked out and…well, there just wasn’t any question about it. So I went off to the University of Illinois as an undergraduate engineering student.
It wasn’t very long after that that I got involved in the musical scene in Champagne-Urbana. By then, I’d switched to mathematics. About 1963, I heard Lejaren Hiller talk about the application of information theory to analysis in music. I was studying information theory at the same time in another class and well… suddenly it just connected up my interest in music and science and technology. That was sort of the first piece of connective tissue.
A lot of people talk about the art part of their lives and the science part of their lives as though they were pretty separate. Was that the case for you?
That talk by Hiller was the moment where they connected. Up until then, I had no concept that they could be unified in any way – it didn’t even occur to me ’til that moment. I ran home and I actually analyzed a solo transcription of Sonny Rollins that I happened to have laying around using Markov chains. I could just take this data that I got from my analysis and use it right away. That was a very important moment for me.
Was it the analysis part of it, or the generative bit?
I started to think about what it would be like to do my work in mathematical and theoretical psychology – which is what I was really interested in – and music. But it didn’t… it wasn’t quite all there yet, but it was an important moment.
Then I went to Stanford as a grad student in mathematical psychology (that’s what it was called at the time) – the sort of application of mathematical models to psychological theory. At Stanford, I kind of abandoned music for a while. Being a grad student was kind of hard for me at first, and I wanted to do well. I was still following music very much but I wasn’t actively performing. And then in ’66, Coltrane came and I went to the concert at Stanford in the Kresge Auditorium. It was really a memorable thing for me – I had seen Coltrane a number of times and Miles, too – but something happened that day after that concert: I had to get back into it again, back into music.
So this would have been Coltrane with Jones and Tyner and Pharoah Sanders? No wonder….
It was the end of that period of his work – his last gig with Elvin Jones, I think. I think that he actually walked off the stage because he wasn’t getting along with Rashied Ali. This was the time he made Kulu Se Mama – basically, that group. But that gig was it. I called up my parents right away and I got the drums out. Since I decided I had to do something about my musical skills, I wanted to play in the orchestra at Stanford. I also got involved in the Free University’s improvisation class and I was heavily into music once again.
So I went over to take percussion class at Stanford and my teacher was John Chowning – the next big piece of the connection – first Hiller, and then Chowning. He started asking me all kinds of questions about perception because he had just finished his work on the simulation of moving sound sources…it was just an incredible contact. Through him, I learned about the whole computer music thing. I heard about the idea of doing it before, but it became real I decided at that point that I really wanted to orient my work in psychology and perception towards musical problems.
I went to my advisor William K. Estes, who was a very famous learning theorist and asked him if I could somehow reorient my thesis work toward some problem related to music. The first thing he said to me was, “Damp the oscillations, Dave.” (laughs) He told me to finish up what I was doing and then go and do what I wanted. I think his advice was just right, but I did take a long time to finish because I got so involved in music at that point that I kind of let my research go by the wayside.
So one thing led to another and we started doing this live electronic music. I met Stockhausen while he was at UC-Davis and I got to hear him talk and hear performances of his music. Again, Chowning being the sort of messenger – the person who brought these people to many of our attentions. I got involved and wanted to do this computer music thing. I just saw this fantastic idea that you could make any sound – the total of this idea of generality was there, you know. In ’69 I participated in the first computer music workshop that they had at Stanford. Max Matthews came out and I learned Music V and got even more enthusiastic about it.
So when I went to take this position at Michigan State University, the first thing I decided was that I was going to do some music perception cognition work and going to get this computer music thing going. So we installed Music V on our mainframe and got a group and a little laboratory going and started doing some work in music perception while I kept up the idea of trying to do some performance.
Then, one Christmas Eve – it was in 1973 – I was sitting reading the New Yorker magazine and there was a profile of Pierre Boulez written by Peter Hayward, I think – I have to locate this piece sometime because it had such a big impact on me. I’m reading along in this text and in the second of this two-article series, there was something about Boulez’ new institute in Paris that was going to be set up and how it was based on ideas that he had about applying science and technology to musical problems. I said “Well now, this has got my name on it!”
I just got all excited about this possibility and immediately contacted Chowning and Max Matthews and Jean-Claude Risset about this institute and found out that, yes, it was really a scene. I wanted so much to be part of that scene that I worked it out so that I could take a sabbatical leave at my first opportunity to do so, and I went to IRCAM. I went there on July 4th, 1976. I remember it so well because we were flying out of Chicago during the 200th anniversary of the Declaration of Independence, and there was a huge fireworks display going off as we were flying out of Chicago – it was quite a send-off.
IRCAM really wasn’t finished yet – it was just kind of a hole in the ground at the time and a concrete shell, and a staff with not a lot of people on it… I got really interested in the way the whole institute was going to turn out. After my first year there on sabbatical, they asked if I would stay on a second year and be on their staff. So I worked out a deal where I could get an additional leave of absence. Towards the end of that second year, they offered me a permanent or full-time position. I went back to Michigan State briefly to clean things up, and in ’79 I became a sort of permanent part of the IRCAM scene.
In those days, it was a lot of mainframe computing and non-realtime sound synthesis on the one hand and then realtime stuff going on around this engineer from Italy named Peppino diGiugno, who I worked with. In ’77 I made a piece called Antony that I did with this realtime oscillator bank that was recorded on Wergo and that I’ve gotten a lot of performances out of. Working on Antony really piqued my interest for the realtime aspects of live performance, although I was still working primarily with these music languages like Music V and Music X and so on.
In ’79 I was asked to run the pedagogy department in IRCAM and to be the sort of connective tissue between the scientific world and the musical world. Of course, I loved being in that sort of a situation because I felt comfortable in both worlds and felt like I’d resolved the tension between them…
There’s one little piece of this that I’m sort of curious about. The kind of art that I understood that Pierre Boulez was interested in making a place for – particularly if you read his stuff like, say, Technology and the Composer – sits in a very distinguished kind of cultural niche – things that follow in the train of High Modernism. But what I’m nearing from you leads me to wonder how Coltrane and your improvisor’s background fits into all this…
That’s right. That’s a pretty interesting question.
Were you a closeted jazz fan while you were there? Tell me how that works.
That’s interesting, I think, because my interest in contemporary music evolved out of my interest in jazz. It happened early on – there was this saxophonist named Sam Andrea who lived in my home town when I was in high school. He must have been in his early 30s or so – sort of the “hip cat” in town. And Sam would tell me what to listen to – the Bartok string quartets and the Rite of Spring and Debussy. Later, when I was a freshman at Illinois, I was reading a Downbeat blindfold test with Yusef Lateef. They asked him what music he was into at the time – what he’d heard recently that excited him. He said that he’d heard this piece called Zeitmasse by Stockhausen which was very surreal. So I ran down to the record store right then and got it – I can remember that day so well. The record had Robert Kraft conducting – one side of this record was Stockhausen, and the other side was Boulez’ Le Marteau Sans Maitre. That’s the first I ever heard of or knew about Boulez. I listened to this music and I couldn’t figure out what the hell it was about – it was just a total mystery to me, but that’s what interested me.
Was there something compelling about its impenetrability, or were you curious about the notion that here was something you couldn’t make sense of?
There’s a kind of delirious quality to both of these pieces that got to me. I listened to it a lot and then I started following up what these guys were interested in – particularly Stockhausen. I think there was more of a pole of attraction there for me than Boulez – because of the electronic works like Gesange der Junglinge, Zeitmasse, and Kontakte. These were all things that got me really excited. Berio, came on the scene, too – another jazz player who recommended stuff to listen to me. But you were asking about what happened with this interest in jazz when I got to IRCAM…
Right.- I’m wondering whether or not you had trouble reconciling those two different worlds – not so much personally, but within the microculture that was IRCAM in those days. Was it an exclusivist kind of place?:
Oh no. Some of the IRCAM people were quite knowledgeable about the jazz scene – not Boulez so much, but I was closely involved at IRCAM with Berio and Vinko Globakar for example, and these guys were much more interested in these other musics than Boulez himself. In particular, Globakar was very much involved in doing improvisation. So I kind of found some partners along the way there. Boulez and I had a very interesting relationship – I kind of think he found me a bit amusing, and maybe he liked my enthusiasm for things – but the point was that he and I got along okay. I’ve never had any problems with him, whereas a lot of people really did have disagreements about particular aesthetic issues.
That’s what I was sort of curious about because in some measure, the place really bears his stamp – some of the writing about IRCAM I’ve read suggested that there were some real cultural divisions at work there…
You probably have seen Georgina Born’s book…
That’s the one. It was a really entertaining read.
Well, I’ll tell you – my code name in that book is Rig. R-I-G. You can go back into the book and probably read about some of what I’m saying here. I think that somebody like Boulez is a fairly complicated mind – he has a kind of a way of zigzagging around. While he does, in some way, have a very strong aesthetic and he’s certainly someone to be reckoned with and he has expressed some intolerance for certain musical directions and so on, remember this, too – for three years in a row, he asked me to organize concerts at the Pompidou Center of new improvised music under the auspices of IRCAM. That’s thirty concerts of what some people call free jazz.
That hardly sounds exclusionary to me. Man, that must have been a ball. So you basically got thirty people you really wanted to hear….
Yeah. I would put on Steve Lacy and the Dutch people would come down, and the East Germans, the Italians, and a number of groups from Paris. You know, if you’d gotten a different type of individual in there than Boulez, they might not have been as flexible. I always found Boulez though to be a pretty complicated man and a pretty interesting guy – I wouldn’t want to try to pin him down or categorize him. I think that Georgina Born simplifies him a little bit too much in the book. I mean, there are certain problems, but now but if you think about music that he’s writing now…
The stuff he’s written since Repons?
It’s really quite light, quite luscious, just quite different from any kind of what you might expect. You can’t just say he’s a serial composer – certainly, there are some Modernist issues, but sometimes I think I might be closet modernist myself…so beware!
One of the things that I’ve talked to him about directly is what it is that attracts him in music and he talked about the delire – which is the French word for it. I think you hear this delirium he’s pointed out in his works – Pli Selon Pli, Le Marteau Sans Maitre – and in Repons as well. He does like that a lot and so I think he can hear that elsewhere. Now, of course he might have problems with some of the screeching and screaming that goes on in extreme situations…
… and sometimes it is undisciplined in a way…
No, but the idea of the delirious body in music is something that is really attractive to him – and it is to me as well… and I think that’s what got me interested early on in music. When I heard some of these things happening early on in the music that these guys told me to listen to, it was like things almost ready to explode. That – and things that I couldn’t understand – just attracted me in music.
We’re talking across genres, too. The first time that I can remember hearing Coltrane recordings I thought – this was like grabbing a live wire – you just had this stuff spilling out at you and you thought, “I don’t understand this, but whatever this is, I want it.”
The point of commonality there that he would agree on as well in this idea of the delirious state and you hear it, you just hear it…
So at IRCAM you sort of had… you found yourself with the resources to begin to look at and explore that quality. But I think of IRCAM in its early days as more a place where interesting taped music is done – Jonathan Harvey, York Holler, Saariaho…
Oh well now – quite the contrary. And that’s interesting that you bring that up because by ’81 – that’s quite a while ago – Boulez made it very clear to everyone that he did not want non realtime music being made.
At all?
At all. Now that did change. I remember being called into his office one day. I had a note from his secretary that said, “Please come and see me.” So I kind of said, “Oh my god, what did I do now?” So I was summoned to Boulez’ office and he said, “There have been reports that this person is using Music V….” And I said, “Wait a minute, Pierre. Look – a lot of people are using this non realtime stuff because there isn’t anything else really available. So that’s how this person’s piece is being made. And, in fact, that how… I just named a bunch of pieces. Boulez felt really strongly about this, but I think he wasn’t quite in touch with what was going on in the institute. He had made this kind of mandate that there shouldn’t be taped music made, and he had a real distaste for taped music concerts- I mean, to the point where he just wouldn’t tolerate it. He really wanted realtime live performance to… to be the key and that’s why DiGiugno was such a favored person within IRCAM. But part of the trouble was that the stuff they had developed wasn’t really being made available to… or it was too hard to use and … I hope I’m not making any revisionist history here…
All oral history is probably a little revisionist, I think…
Yeah, I guess it is. The thing was – maybe I should tell this story: I went to Japan in the fall of 1982 and was invited back again in the fall of 1983. That was really just the beginning of MIDI – the MIDI 1.0 spec was sort of put in concrete around August of 1983. Anyway, this girlfriend I had – Ushio Torikai – had arranged to get a concert sponsored by Roland that we were going to do in Studio 200 at the Seibu Department Store in Tokyo. So I went down to Hamamatsu and we met with Roland. The IBM PC had finally hit, and they had a prototype of the MPU401. I got this gear from them and went back and wrote programs in Basic for a week and did a concert. In this concert, the idea was that we were going to have three different musicians playing the same instrument via MIDI and influencing what each other had done somewhat.
Well, that was my first experience with this stuff, and it became clear to me that somehow the personal computer was going to have a big influence on what goes on in music. So I went back with incredible enthusiasm about all of this to IRCAM and I wrote a little proposal which I entitled, “Just a little bit of real time music for 30,000 francs” which was about $6,000 at the time. The proposal consisted of an IBM PC and a DX7 and an MPU401 – a little MIDI system. We had a budget arbitration meeting and my proposal was handed around the table to be either voted up or down by the IRCAM staff. Man, I wish I had that document now – I wasn’t able to retrieve it. But it had all kinds of nasty remarks were written on it by various people in the room. Of course it was voted down completely as being vulgar in the French sense of the word “vulgaire” – commonplace – not something that we should be doing.
But I didn’t exactly give up. In 1984, the Macintosh appears, and now Adrian Freed was around at IRCAM as the systems person. Adrian’s one of these remarkable people who’s just on top of technology and what’s going on, what’s happening. He’s really a boon to what we do. So he was the systems guy around the institute at that time and we were running a VAX and UNIX. Anyway, I managed to make contact with Jean-Louis Gassee through a woman named Marianne de Gordelfis and we ended up getting 6 Macintosh 512s donated by Apple to IRCAM. I’d been working on this throughout the summer of 1984 so the 128s were hitting Europe in the spring, late spring. And then the 512s were about to hit in September of ’84. So it’s the following fall – the year after my IBM proposal so then I had the machines in hand and then someone objected in a meeting – the budget arbitration meeting in the early fall of ’84. The question was, should we keep these or give them back to Apple because it was considered maybe a “cadeau enpoisonee” – vulgar machines coming in, machines that people might have access to…
— oh, that would be terrible!
I could not believe it and I don’t want to mention names in this – we’ve somehow gotten over some of this. But I felt then as if I had been accused of going around the back door and somehow of doing this on my own and — getting this involvement with Apple without proper institutional approval. But, to give Boulez credit, he said, “Okay, look – you can keep them, but you’re not going to have any money to do anything with them…”
Basically, “There are some limitations on the resources you have, and we’re not going to invest in it, so don’t spend time over this…”
Basically, it became clear that people liked these machines – they started doing all their work on them. MacPaint and MacWrite and MacDraw – these things were a lot easier to use than anything we had at the time. At this point, Adrian came back to IRCAM after some time at Bell Labs. We sat down one evening in a restaurant in the summer of ’85 and designed the MacMix program on a napkin. Basically, it was a Macintosh front end to a mixing program that was running on the VAX. It was a way you designed your mix with envelopes and so on. Anyway, he developed all that very quickly on the Macintosh. Also, there was a protocol for talking over the serial port to the VAX. It got put to use right away by George Benjamin to make a piece.
At the same time, Miller Puckette coming around and saw the opportunities that we were working with and trying to develop software that could be used in live performance on the Macintosh. One thing led to another and a lot of attention and finally at that point they decided that maybe I should go off and start a separate group at IRCAM based around personal computers- they called it the “Systeme personale” group. So I was moved out of the pedagogy world over to this new group, and I moved up out of the hole into a different space which was in the old school building. We were actively involved in this LISP – development we called MIDI LISP. Adrian had taken the MacMix idea and gotten it into the commercial world it was what became the Studer Dyaxis system. So, things were changing at this point. The battle was clearly won.
Maybe I’m being dense here, but how could the idea that musicians would want “personal” instruments, so to speak, have been that hard to see? It just seems like such a no-brainer…
…That somehow musicians want personal instruments? A real no-brainer. I just thought that the whole mainframe idea just wasn’t going to go anywhere. So I did, you know, feel vindicated by all that happened. I guess maybe that’s something I’d sort of like to claim a little responsibility for, anyway. So Miller Puckette and Phillippe Manoury started working together and Miller then was using a Macintosh to actually control the IRCAM 4x machine – the DiGiugno machine with what was an early version of what became Max. The earliest version of it was called “patcher”.
Well I switched over to using it from a LISP environment at that time too because it… no, at that time, I was working in the MIDI LISP environment, doing this piece with Roscoe Mitchell. That meant that I stayed with the LISP environment for a while, but I switched over to using Patcher from a LISP environment. About that time, I started getting courted by Berkeley and wound up getting this offer to come to Berkeley in the fall of ’88. I turned in my resignation at IRCAM in April of 88. I’d met David Zicarelli a few times. I’d gone to Opcode early on to get MIDI interfaces back in the very beginning when they were in a garage in Palo Alto. I think I met David the very first day, and I learned about his patch editors and the librarians – the stuff he was doing. So what came of that was that I wanted David to come to IRCAM and to talk about Macintosh programming. So I invited him and it was in the fall of ’88. I’d already resigned, but it was sort of the last thing I did. And that’s when Miller and David met. He and Miller hit it off right away.
And the rest – with some gaps – is uh…history. But you brought Patcher or Max or whatever it was called by this time with you to Berkeley?
That’s right. Of course I was really enthusiastic about it and I started teaching it right away even though I didn’t really have a computer lab when I came for my first year here. I was kind of teaching things which were yet to be in a program that was in development in a building… my first year here was nothing. I didn’t even have an office really yet because this building wasn’t quite ready yet. But anyway, that’s it. That’s how I got here.
So this is some kind of answer to the question, “Daddy, where did Max come from?”
Oh, that’s sure not the whole story – I didn’t really do anything but to be someplace at t a certain time with some ideas and to provide a space and encouragement to Miller. And I did start using it in its very primitive form at the beginning.
What attracted you to Max?
Well, see, I was already interested in this notion of doing some kind of interactive improvisatory thing with a computer where the computer would be able to play lots of notes – multiple events and gestures – that I could control in some way. So I had made these things in this MIDI LISP environment a long time ago. I wrote a paper about it I’ve got somewhere…
When Max came along, it was just a lot more efficient implementation that I was able to work with. I didn’t have these problems with garbage collection and so on since I had this patching concept from the Music V-X world already. But it wasn’t about sound at that point – it was just about events flowing around. And it was early, too – I can remember the way the right to left order thing happened. It’s probably hard to imagine, but at first, Max didn’t have any notion of eager and lazy evaluation; if you put anything in any inlet of the plus object, you’d get an addition. You had to build all this stuff around your objects to keep things from getting weird. You’d really be careful about when you excited an object because any inlet would make it fire and then…well, Miller got the idea that making only one inlet – the left one, the one that made it fire.
(laughing) We just spent some time in MSP night school learning how to make it fire on both again.
Now the other thing that Miller added was the idea of abstractions. I had this piece that required me to replicate the same set of modules many times, and abstraction didn’t exist in the first versions of Max. In fact, it still didn’t have the notion of making a sub-patch. I always remember spending a whole night copying a patch over and over and over again just wiring out the same thing like 88 times – I had to do it for each key- Miller saw me doing that and said, “Yeah, you know, I’ve got abstractions coming along….” He told me the other day while we were talking about it that seeing me suffer was really the thing that motivated him to get the abstraction thing going!
But what was at the heart of things was that high degree of interactivity in music, dialogue… for me, these things come out of the jazz world for me. But also I was very interested in Indian music – music in which people perform together and kind of have a discourse of some kind. I always just thought that computers ought to be involved in something like that.
If that’s the case, what does the computer do?
Let me say something a little bit more about that because there’s another feature that was coming out of this jazz. Now you gotta understand this time- it was the 60s. Jazz was going through incredible evolution in terms of its language and going in many different directions…
Electrification, the new timbres, the introduction of modal structures….
… modal stuff, what happened when people like Cecil Taylor appeared on the scene and then the free jazz kind of thing – although I never liked that term very much. I mean, there was just this incredible evolution going on. It seemed to me that jazz musicians were people who had to invent a sound of their own – a personal sound. It was almost like they were almost like instrument makers in a sense- they built a sound. Often times it was a very important part of what happened, and they would invent a kind of language that was a personal language. It seemed to me that computer musicians could do that kind of thing, simply because they were required to almost invent their instrument from the ground up. It seemed totally compatible to me with this kind of — aesthetic or ethic in aesthetics that I had about music the way it should go. It seemed to me that was kind of an ideal. My involvement with my friend George Lewis, who was at IRCAM in the early 80s was important too – the kind of thing he was doing where the machine would react to things. So… how is the machine involved, you’re asking…
How has working with technology changed the way you work?
I guess that part of my interest in it has to do with the simple fact that if you see this stuff and what it can do, you can’t ignore it – you have to use it, you have to do it. I think I saw that already when I first read about it in ’63 or so…
Well this sounds like your story about leaving the Lejaren Hiller lecture: you see the thing and then you rush home and say, “I gotta do this, I gotta mess with this…”
…Gotta mess with it, got, gotta use it. If it’s there and has this potential, then it has to be that you incorporate it in art. And then there’s a tradition in music through technology -development in the whole way acoustic instruments evolved and so on: as new ideas would creep in, they’d just have to be exploited.
One of the things about your own work that I think is interesting is the set of ideas about the use of input material in improvising situations, and the kinds of abstractions you use to work in this area. I wonder if you could talk about it a little bit.
I’ve used this in all kinds of contexts. But the basic idea is that you have an underlying process that is running along, but it’s actually silent. You’re also able to set it up and select various options. You can call up the kinds of data that are running along, and then I dip into it as if there are multiple streams of things. I can dip into that one and dip into this one and dip into that one over there and bring these things to the surface.
That paradigm I’ve used means that I don’t have to be responsible for the activation of each note. There could be like lots of material and what I’m doing is, in some sense, driving it around, focusing it, and orienting where it’s going to go. I’m able to control larger parameters associated with what I bring to the surface like the density of notes and the kind of rhythmic structure, but at the same time I can stop and have it all just be under kind of tight control. One of the problems that I had early on in some of the pieces I would try to make is that I didn’t have good control over the dynamics and I just couldn’t stop the interaction – I didn’t have a neat way to, like, get into a little dialogue kind of thing, a relationship with another musician where…
…where you’re directing from a discrete distance?
I’d basically take it all in. I didn’t control the dynamics, and I didn’t control the densities and the stopping and starting and turning on a dime. That’s still a problem for me – I often feel terribly frustrated in performance, where I can’t go somewhere where I just wanna go. That motivates me to go on back and modify the software so I can try to build in more of that flexibility, so that I’m “dipping” into material that I know things about from experience and practice. I think that all kinds of temporal details are important for feeling and phrasing and articulation and so on – while I’m maybe not changing the way that the notes come out in time, I can alter their lateness or earliness – you know, where they’re around where they’re supposed to come.
I’m also motivated at this point by the idea of using intelligent listeners to help me listen to the other performer and analyze the data that’s coming in. In this piece that I did the other night with Georg Graewe I used these kinds of ideas. All the material is generated from what the other musician is doing: In Georg’s case, he’s playing the piano. I’m able to capture what he played – in this case it was MIDI data – into a bank of 12 recorders I have arranged on a normal keyboard. I can play back that material, transpose it, and play back further abstractions of that material from other keys that I’ve set up. So I do a sort of realtime analysis using Markov chains and various hidden Markov models to try and track melodic processes and so on. I keep these tone profiles around – ideas that have come out of music perception cognition work – and try to use that.
In fact, my interest in music perception and cognition is often primarily driven by the idea of trying to build things like parsers. I’ve got something that finds the beginnings of phrases and the ends of phrases and tries to say, “Well this is a phrase, and here’s my best bet what might be, so I use this sort of time gap rule notion and…
So your performance is a sort of a guided journey through a landscape whose features you’re pretty familiar with, but whose particulars are unpredictable – and thus interesting to you?
Yeah. Also, the software has features that allow me to make new combinations of the material that I wouldn’t normally think of. I get excited about the idea of working with something where I’m… when I’m performing or playing, I mean that I get… yeah, into some new territory.
There are people who think about doing computer music or experimental music as an act of constructing and specifying. While some people don’t accept that there’s a distinction that you can make between pieces and instruments at all, there is this sort of notion for some people that a piece is an instantiation of a certain kind of technological solution. What I’m hearing from you sounds more like there’s this kind of basic core set of ideas and those core ideas are some kind of faceted thing that you’re turning over and showing us another side of. Sounds like what you’re doing isn’t a single solution at a time kind of thing – you’re moving this “dipping into it” paradigm forward and modifying the thing as you go.
I like to keep evolving the software. I guess that my dipping thing has had something like 10 revs on it for different situations by now – all in Max, by the way.
Do you think that Max is particularly suited to that? Why?
Well Max is just the best thing. I mean, I look out there and ask what else there is and… there isn’t anything. I don’t mean to sound like I’m blatantly making a super plug here, but I am: There is nothing that satisfies such a complex set of things that’s running on machines that are available that I can just take out there in public that’s got reasonably low latency, that sort of thing. It’s just not entirely the case in the PC world and the MIDI toolkit from CMU or other languages that people have suggested are interactive. You can build things that act like instruments with it – that’s what drives me and my enthusiasm for it. It involves you at that instrument level. I can build this whole highly interactive reactive system and work with it, evolving it as I go.
San Francisco resident Carl Stone has composed electro-acoustic and computer music exclusively since 1972. He has been commissioned to compose and perform his works in the United States, Canada, Europe, Asia, Australia, South America and the Near East. In this 1999 interview with Gregory Taylor, Stone talks about his methods for composing with new technologies and the artistic implications of sampling.
One of the things I think that’s both somewhat invisible and still intriguing about your work is the technology that you use to make it. In part, that might be because the materials you use direct the listener’s attention away from the “how” to the “what”. I expect that you might be one of those people that either get all kinds of questions about gear or no questions at all. Which is it?
It depends where I am. I lectured at the Art Institute of Chicago and I didn’t get one question about gear or software – the questions were all from an aesthetic point of view, which is great. When I’m in Japan I do get a lot of questions about gear. It’s a legitimate question because it’s not obvious, but I frankly appreciate this particular line of discussion we’re having a little more – more on the aesthetic line of attack as opposed to which sampler I prefer.
Presumably your choice of tools had something to do with the kind of idiosyncratic ends you wanted, but I’m wondering about the way that things like hard disk recording changed the way you did your work in your early works.
Sure. Hard disk recording allowed me to do things that I aspired to. Years ago I was working with turntables and delay lines. Then, this Publison DM89 came along. It was my instrument of choice for a number of years. It was a high-end box designed for studios to use. It was very expensive at the time, too – and I had saved up for quite a long time to get one. It was only after it was stolen from me twice -
The same box?
The same box. I had a studio in my house, and my house was burglarized. They cleaned me out, including this box – which was a five or six thousand dollar piece of gear. Of course, it was insured – so I had this check after break-in number two and I asked myself, “Should I get this box for the third time?” It’s 1986, MIDI has arrived, the Macintosh is affordable, and sampling has come into the realm of the consumer. So, basically I thought to try something new. I saw it as a chance to do what I’d been hoping for a long time with my Poubeçon, which was to get some kind of programming ability and some kind of precise control over time – which I’d really never had. So the answer was obvious – it was time to try this.
What’s the first recording that comes out, after you acquire this equipment?
It was a compilation on the Music & Arts label that had two of my pieces on it – Hop Ken and Wal Me Do. Those pieces reappear in different performances on the CD that I brought out myself in 1989 called Four Pieces.
Was the business of trying to use the different technology to reinvent yourself stressful?
No, I didn’t feel stressed at all. I just cancelled all my appointments for half a year – my social life went completely to hell. I just worked more or less continuously for a long period of time ’cause I was really totally fascinated by the technology.
So I hear you’re a Max and MSP guy now.
Well, I’ve been a Max user since the product first became commercially available around ’91 or ’92. But before that, I was interested in the use of computer programs for algorithmic composition, one of which – M – David Zicarelli had had a hand in. M was certainly an important program for me because of its interactivity; it was a kind of performance tool and a performance instrument that allowed a certain amount of controlled randomization that you couldn’t get with straight sequencing tools. Sequencers for me are not really appropriate for live performance – I’m not just interested in the straight playback of MIDI material – so M was really a wonderful thing.
And then Max extended the ideas of M, and gave you really a full palette – a complete toolkit for building your own MIDI processors to do whatever you wanted. Because my approach to making music is pretty much outside the mainstream, I couldn’t really be satisfied with most of the tools that were in the commercial marketplace for software at that time. From ’92 to ’96 I was using the standard setup – using a computer with a program like Max to control MIDI sampling instruments.
But when Max/MSP came along, it became obvious that this was the key to the future. These new fast G3 computers eat MIDI for breakfast; you can do everything you had previously done with MIDI and external boxes before internally with a single machine now. From just a convenience standpoint, I’m very grateful not to have to be hauling around lots of racks and pounds of equipment when I perform and tour. From just a convenience standpoint, MSP is a wonderful thing. But the other thing is that MSP allows you to build and customize your own tools to do exactly what you want, or even things that you might not know that you want. The commercial devices, which are created for a mass market and for the generalized tastes of the mass market cannot do that.
To be fair, you can perhaps tinker within limits….
They’re optimized for a general purpose, which is driven by market factors – that’s just the reality. But MSP is different – it’s more flexibility-driven than market-driven. It’s just great for composers like me – we can build and customize the things we use for ourselves. If other people are interested in them, that’s just great. But the tool itself is so non-specific – it doesn’t have a lot of specifics built into it in the way that a sequencer does. There are a lot of things you can do to defeat the assumptions of a sequencer, but you have to consciously do it – with MSP you start with a blank slate always and build out from there. Really the thing that drives it is not the marketing imperatives of a software tool, but rather your own instincts and imaginations – and that’s what’s really great.
So before the arrival of MSP, you were running Max and triggering a rack of samplers and effects processors?
That’s right. My system at that time was pretty stripped down – I was kind of proud of the fact that I was doing everything that I was doing with just a very simple sampler, a Powerbook, an Alesis Quadraverb and a mixer, all being controlled by Max using MIDI. Now I’ve basically thrown out the sampler and the mixer and it’s just done all with a fast computer and MSP.
So it’s all laptop. That’s gotta make touring a lot easier – you just go and plug it in…
I’ve always admired a trumpet player, the guy who gets the call at five o’clock and hears he’s got this gig, and is heading out to the airport at 5:05 with his instrument. I’ve always wanted to do that and now it’s a reality because all I really need to take is my Powerbook and a change of underwear.
So now that you’re an MSP guy, I’m curious about your current situation. How do changing technologies alter what you do? I would be inclined to think not a lot except for the efficiency of working without all those encumbrances….
You’re right, it hasn’t made any fundamental changes. My approach is still the same after all these years in the most general way. The tools are different and the efficiency is increased, you’re right. When I first got MSP, my first tasks were to kind of sit down and figure out a way to model and emulate what I was doing with sampling – external devices and MIDI – how to do that just with a Powerbook. But then it didn’t take much time to realize that, and then I was left everything else that’s possible, which is not necessarily about imitating or modeling preexisting devices, but taking new approaches that were available to me for the first time….
Let me see if I’m getting this right – you learned MSP by taking what you already understood how to do and then doing it using MSP?
Well, yeah. After being in this field for all these years, you develop habits and approaches which are basically the way you think or conceptualize a compositional problem. So, rather than completely rewriting the book, the first thing you do is figure out how can you can do what you know, and do it better. Then – because you don’t want to be doing the whole thing for the rest of your life – at least I don’t – it leads to something else, something really new.
Once you’re done with the implementation, you have a system that runs on your Powerbook that does what you did the last time you did something. When you think about moving past that, is the next step altered by your encounter with the technology?
It surely is. And it has to do with my fundamental approach to composing, which is that I very rarely start out with a fixed idea that I wish to realize, but rather the act of composing for me involves a considerable amount of simple play by using materials and processes which I construct myself. The process of play reveals something about sound and material and the sources that I’m using which, in turn, then, realizes something about form and content and so on. Eventually, this becomes a piece of music. And because MSP suddenly expanded the whole range of processes enormously, you have a whole new sonic world available to you once you break out of the old way of thinking and start a kind of new extended way of thinking.
So, what you’re doing before you create the thing that will become the piece is a kind of interactive listening.
Yeah, that’s exactly what it is – interactive listening which is predicated on some kind of harebrained idea about what might work and what might be interesting, constructed usually from some very simple process which could be used to generate an entire piece or to generate one line in a piece, or one section in a piece, or some subset of an entire piece.
I guess a lot of the other people I’ve been talking to have been talking about perfecting process, rather than creating a process and then kind of listening to the way it interacts with things that you bring to it. So I’m curious about your post-MSP work – I’m curious about where you’ve gone since that happened.
The first big piece I did using MSP was about an hour’s worth of music that I created during a one month period when I was composer-in-residence at the Djerassi artist in residence program. Djerassi is a beautiful compound in the hills in the south of San Francisco, down the Peninsula on the way to Woodside, Silicon Valley-area. It’s a ranch owned by Carl Djerassi, and about twelve artists go there to live in an isolated natural setting, just themselves and a small staff – to really be away from the distractions of everyday life to – in my case – compose. I had a project at hand, a collaboration with a choreographer and dancer from Japan by the name of Akira Kasai. The performance coming up a month after my residency would be over so I just sat about with my copy of MSP, my manual, and a form scheme for a 90 minute dance piece-about an hour of music – and began to jam. The hardest part was pre-selecting the materials that I would bring with me to use as fodder for my sampling, so I just brought an enormous amount of stuff and selected from that. Along the way, I just constantly tried out different techniques based on my imagination. Some of them worked, some of them didn’t. You know, you work really hard for a month and the fax machine is off, and the phone is off and you don’t have email – you get a lot done.
Coming out of that month, what do you wish you knew about MSP before you started?
Hmm… I have no real complaint about that, because I really started from zero.
There are people who encounter the learning curve of a technology and come out the other side and say, “I really wish I’d had a sense of this,” or “I’m accustomed to working in a situation where the languages I work with for programming are hierarchical, and I find Max and MSP complicated to work with because I expect hierarchy and I don’t find it.”
In my case, it’s neither because I don’t crave hierarchy. I like the kind of non-hierarchical blank slate approach that Max and MSP give you. Because I’d been a Max user for a number of years before adopting MSP, I was very comfortable with the interface and the programming style and approach that Max embodies as it’s further implemented in MSP, so I felt reasonably comfortable. There are some obscurities in MSP and – this is not a knock on MSP – I’m not personally very well grounded in math or acoustics, or digital-audio theory. When you start to work with the objects that are really deep like buffer~ and fft~ and ifft~, you do kind of need that stuff. At that point, I had very little grounding in that and there wasn’t really time to go deep in that period because I had to produce a whole hour of music in a month. So, I kind of put those on the shelves and out of reach for that period. I guess I wish I had known more about those things at that time, but it worked out okay.
I think that one of the really helpful things about trying to learn digital signal processing is that you can sit down and fire MSP up and really start screwing around with an audio stream or the contents of a buffer – tweaking it and discovering that what comes out the other end sounds kind of like reverb, or a swarm of bees. While some people are happy with the math or bithead parts of it, I never had the hang of it until I saw what it could do. I came out of the other end of it thinking, “That’s why I need it. Crap ! If I knew this, it would be a lot quicker.” But there’s a lot of wonderful damage to be done to stuff in the process of learning.
Of course, even if you don’t know that, you can still spend a lifetime doing everything else. Last April I was in Italy for a month in a thing that was like Djerassi, that was sponsored by the Rockefeller Foundation – I was at another artists’ retreat called Bellagio, but the difference for me was that I didn’t have a project at hand or have anything I needed to do, I just used it for research and going deeper inside some of these objects like buffer~ and so on, and that was very useful.
So what kind of Max and MSP work are you doing now?
More and more towards these kinds of things that I’m talking about where you get in at the bit and byte level and start peeking and poking around buffers and fooling around that way. I’m interested in resynthesis, and doing more with that – that’s what preoccupies me at the moment.
You said that one of the things you’re working on now is installation work. That’s quite a change in direction, isn’t it?
Sure. Almost all my work has been for performance or working with other media – time-based work that starts, proceeds, and then ends. I was very happy to have had the invitation to participate in a project in Japan where a number of composers were asked to create pieces for a kind of a sculptural instrument called Incubator – 50 iMac computers in a network. The instigator for Incubator was Mr Masayuki Akamatsu, who also made one of the pieces for it. This opportunity got me thinking about networking ideas and using Max and MSP to realize that. It was completely the appropriate tool.
So what did you actually do?
My piece for Incubator was one of the richer ones compared to the other composers in terms of the materials. It used a lot of sound files graphics, Quick Time, dynamic texts…
There were 50 screens to watch at the same time?
Yes, 50 screens – although there was a certain amount of visual repetition throughout the 50. Sonically, you can make a joyful noise – a lot of racket with 50 iMacs. They were set up in a kind of a grid pattern, and people could wander around in between them and observe what’s going on the screens and listen to the sounds. The sounds tended to mass in the room, but if you got in close to any computer you could hear what was going on with that particular one. There were actually six, at any time, six different programs running at the maximum.
Were the machines networked together?
They were networked together and some composers actually passed data in between. One composer had an interesting idea where they used the internal mike and internal speakers of the computers plus objects that could sense the absence or presence of sound so that machines would actually listen to each other and have conversations based on what they heard. In my case, the network was very rudimentary and simple. The programs were designed and installed on the machines. All the programs looked at a master synchronization clock, which was supplied by the network. Depending on the time of the hour, they would react in certain ways.
I’ve never heard of you doing anything like that before. What did you think about it?
It was my first time working with a network like that so I learned a lot along the way. I learned what worked, what didn’t work, what could’ve been better. 50 machines – it’s kind of an orchestra. I think that if I examined the piece that I did for Incubator, it could’ve been more dynamic – I should’ve gone the whole range from one to two to ten to 50, but things tended to be either on or off, very soft or very loud. In fact, I’m doing an upcoming piece in Mexico City that’s a piece for 20 computers. This time, I’ll really play with the dynamics so that each computer is its own voice and you have the full range.
Your using the word orchestra interests me. My first thought was that what you’re describing didn’t seem very much like the way we think of an orchestra as kind of timbral engine. Maybe after the 19th century we don’t do that anymore….
One tendency in my work is the interest in compounded masses of sound through a technique of layering. I’ve done that with my old taped pieces and then through the digital cloning of materials, up to 16,000 layers of the same sound, and when you’ve got 50 computers in the same room, it kind of cries out for that kind of layering.
And you can spatialize is as well. Nice inexpensive spatialization – all you need is 50 computers.
Yes, very inexpensive [sarcastic laugh].
Since you brought up the notion that layering has been a longtime compositional interest of yours, I guess this is a good place to ask about how you started working like this. How’d it happen?
I was interested in and passionate about music since early age, and studied classical piano when I was very young, but never really took it all that far. I wasn’t disciplined enough to really practice, and I had no aspiration to be a pianist. But I continued with my keyboard skills, working in high school bands. I played both bands and keyboard in some groups that included some people you might know, even – like the percussionist Z’ev – who at that time was a Valley boy like myself by the of name Stephan Weiser. We had a blues band for a while, and also more of a western improvisational ensemble called The Sonic Arts Group. The Hogfat Blues Band featured a female vocalist named Wendy Steiner who later became the Nashville songwriter Wendy Waldman. My influences at that time were Captain Beefheart, Frank Zappa and The Soft Machine – I really liked what Michael Ratledge was doing with his keyboard work, doing a lot of modification of his sound. It was what got me interested in electronics, and that led to an interest in synthesizers. The early 70s were when that was all coming to the fore – the Moog and the Buchla synthesizers were becoming viable instruments. Cal Arts started in 1970, and I began working as a student there as an electronic music composition major. I was equally divided between working with electronic sounds from the Buchla synthesizer as well as working with microphone-collected sounds and using the tape studios at, at Cal Arts. I parlayed that into a job as a music person – I worked for radio for a number of years as music director at KPFK, the Pacifica Station in Los Angeles. That continued, with me working as a composer in parallel to that, till I left the station staff in 1981.
How did you start working with appropriated and found material? What was the genesis of your interest in appropriation?
There were a couple of things. At Cal Arts, I had a work study job in the music library. My job was to tape all of the records in the music library onto cassette. They did this as a kind of archival project because they figured that the records would wear out and, and I guess they figured cassettes would last forever [laughs]. They set me up in this tiny room with four turntables and four tape recorders and a patch panel. Basically, my job was to just run dubs constantly – I would set up four in a row and play them all together. At first, the challenge was deciding which one I wanted to monitor – I could listen to Machaut or electronic music, or I could listen to some Pygmy music, and so on. Basically, it was up to me. Then I started getting into listening to combinations of them and doing kind of collage and mixing. Maybe that was the genesis of it all, although I wasn’t thinking as a composer – I was thinking as a guy who was working in the music library, but it definitely had some aesthetic impact.
After I finished Cal Arts, I worked in a radio station, where my resources were completely different. At Cal Arts, I had access to what was then a fifty thousand dollar electronic music synthesizer and a lot of tape recorders and mixers and stuff like that. After I left Cal Arts, I had nothing except what the radio station had – which was a couple of turntables, a couple of tape recorders and a big classical music library. So I asked myself – how can I make my piece? What can I do?
And I had what you could politely call an inspiration – you could also call it sort of a stupid idea. I recorded the sound of Igor Kipnis playing Henry Purcell’s Rondo from Adbelazar – the same theme that Benjamin Britten used for his Young Person’s Guide to the Orchestra – onto the left channel of a tape recorder. Then, I went back and I recorded it on the right channel – the same tape, but displaced a little bit in time. So you had this kind of small delay effect that created a kind of a rhythm. I mixed those two channels, recorded them onto the left channel of my second tape recorder, and then went back and recorded again those two tracks onto the right channel of the second tape recorder – again, displaced in time, but by a different amount from what I had done before. So you had two delays happening, four tracks of material, and a little more complicated rhythm was starting to happen. I rewound all the, both tape recorders, went back to the beginning and then mixed the four tracks that I had now onto one in the mono, and then recorded those four tracks on the left channel of my first tape recorder, and went back and recorded on the right channel of the first tape recorder.
You can see what I had going here -my one had become two had become four had become eight….I just kept it going through 16, 32, 64, all the way up to 1,024 tracks of the same material. And what I noticed first of all was that the character of the sound changed completely. The harpsichord – which in the beginning had this kind of plinky thing happening – became more of a kind of a shimmering effect as I added the layers, but still with a feeling of rhythm, however complicated. As I got up into the higher levels of layers – 256, 512, 1024 – all of the feeling of rhythm basically fell out. All the smaller time details of the sound dropped away completely and you were left with the broader harmonic contour of the piece – the harpsichord sound had evolved into something completely out of this world, both denotatively and figuratively. It was interesting to me that this had happened – in large part because of where the sound had started out in the beginning. So I thought, well, the audience would find this interesting too. Why not just present the work in series where the form and the content and the process are all merged into one thing? Kind of pedantic, when you think about it in retrospect. But it was very much in keeping with the kind of minimalist movement of the time and the work of people like Alvin Lucier was doing in pieces like I am Sitting in a Room. I was very influenced by that when I was a student and so I basically applied that as a kind of formal device.
There are composers who find it difficult to understand the idea of appropriation in anything other than specifically ideological terms. Your story seems to be more about a compositional technique that you happened on serendipitously. Do you find that some of your audience expects you to account for a set of attitudes about appropriation that you may not have, or are there attitudes that you developed about the notion of appropriation and ownership in the process of working?
You’re correct. When I started on this path, I didn’t really come to it from an ideological point of view and I had not developed a specific set of theories behind it. I was aware of movements in the art world that used appropriation – Warhol, Lichtenstein and Rauschenberg. I also knew of Duchamp, who had used found objects and appropriated work in their own. So I knew intuitively that what I was doing was consistent, and I did not have any doubt about the ethics of it. But in musical terms, I really hadn’t thought or searched for any precedent and wasn’t all that much aware of them – although if I’d thought about it I would have realized that in fact the precedents go lots farther back than our current century in music.
But it seems to me that when we think of quotation as a musical device – at least in those historical situations – we have this idea that when a “real” musician borrows something, there are these notions of compositional skill used in that borrowing and the formal devices used to do it. It seems to me as though they’re presented as being somehow qualitatively different than skills that you’re talking about – the skills to imagine the timbres which emerge from displacement, and so on. I’d think that there’s some critical pushback there….
They may be different, but so what? They’re still skills – they may be different, you can’t deny that skills are involved. For me, one issue with sampling is that when you listen to a piece of music whose composers use appropriated musical material as a starting point comes down to a simple question: Does the musical interest of the final piece derive from the material that’s sampled in the beginning or does it come from something that’s done to it? If the answer is the former, I have my doubts about the work. But if it comes from the processing of the music somehow, then I have absolutely no problem with that.
It seems to me part of the question about the idea of working with appropriated material has to do with its visibility and transparency. I suspect that there are a lot of people in the universe who listen to your work the way I do, which is to occasionally play trainspotter – to try to recognize source material. Is the invisibility of source material important to you? Is there a certain sense where the invisibility of the source material is attached to more visibility for you as the composer?
It really runs the gamut. A lot of times in the earlier works it’s very exposed, and very often from the beginning. Early on, I had basically two techniques – I was kind of in a rut. A piece would either start out naked to the world and then would somehow develop into something completely new, or I’d begin with something completely foreign and unknowable which transformed itself into the familiar over the course of time. While both are fine, I like to take a little more complicated approach now where I think things are sometimes a bit more understandable and you can put your finger on them, or nearly so. In a piece like Nyala, the ambiguity is a little higher – if you listen, you hear Jimi Hendrix jamming together with Miles Davis, but you’re never sure if those are really the samples that I’m using or if it’s an illusion I’ve created. There’s an element of alchemy now that I’m interested in, and I like that kind of ambiguity and uncertainty – that queasiness that you have when you’re not exactly a hundred percent sure what’s going on. But even to this – today in the music that I’m doing there are times when it still becomes patently apparent.
But it’s also the question of where we stand with the law and how that’s changed. In the beginning when I had no reasonable expectation that my work would be released commercially, I could go in and use Michael Jackson or use the Temptations, Four Tops, or those kinds of things. I have a piece called Shibucho that’s all based on Motown. Since that work was never intended to see the light of day commercially, I could just let it all hang out. I guess I never thought about this consciously, but now that my work has found some release in the commercial marketplace, I guess that I am subconsciously putting things a little more under the skin, putting a veil of gauze over the sample – so that I won’t be getting a letter from Island Records one of these days.
Do you see the business of live performance as being qualitatively different than the material you produce on compact disc because of the nature of the performance or because of the circumstances under which it’s made? I don’t want to belabor the technology issue, but in a sense different technological resources might be brought to bear on what you do.
It’s a very legitimate question. Nyala could not be performed live. I’ve done concert performances of sections of it, but the piece in total could not be done live. It is therefore by definition a studio work. Other pieces that have found their way onto CD are documents of live performances that I do and other pieces are simply created in the studio. My first released recording which came out on LP, Woo Lae Oak, was a studio work done in a tape studio. It was commissioned for the purpose of radio broadcast. And along the way, it falls into a kind of a fifty-fifty differentiation. My bread and butter is performance now, and so works tend to be created with that in mind. So I’d say it’s used more in the favor of pieces made for live performance, which then eventually I like to bring out on CD in hopes of meeting a larger audience.
One of the interesting things about Max and MSP for me is a kind of historical irony – that Max saw some of its beginnings in the bowels of an institution dedicated to High Modernism and a certain set of attitudes towards composition. By virtue of a number of hilarious historical incidents and accidents, it has now landed on the desktop of all kinds of people who have no particular investment in that cultural discourse and are busy building their own nonhegemonic memes, just whacking away with it.
I think the work that Miller Puckett did at IRCAM back in those days must’ve been considered somewhat heretical to a certain extent. But even to the extent that it wasn’t I think that the trend toward the democratization and personalization of music was absolutely inevitable. It couldn’t have been stopped by even the most powerful music Czar.
Most of the time I think of interesting cultural exchanges of music as things that make their way from the margins to the center. Max and MSP strike me as kind of peculiar because in a way they have gone in the opposite direction – from the corridors of cultural power to the clubs and art galleries of the world. In turn, there’s this reflected wave thing that happens, too – the technologies have moved out to the edge, and the work that happens on the edge washes back to the center and renews and changes things. I just heard that this year’s Ars Electronica prize didn’t go to an academic composer, it went to Richard James (the Aphex Twin).
Yeah. Institutionally, they made a conscious effort to open up and proactively involve composers from outside of the academy. By getting submissions from outside for the Ars Electronica Digital Music awards and facing the whole breadth of musical material that they didn’t have before, that’s what they get.
How do you feel about that?
Well, not commenting on the specific wisdom of who did or didn’t get the prize, I think it’s a very good thing, I think that prizes like that should really look at the whole breadth of musical activity for what they’re worth. To say that it’s only open to the academy is obviously very self-limiting and silly – I don’t have a problem with that.
I’m curious about the way that you think about the kind of manipulations that you used to perform. There are any number of artists – DJ Shadow comes to mind here – whose recordings have a pretty bewildering mix of interleaved material from turntableland. The overall feel of that there’s something immediate about it. It seems to me that your work comes from a more gestationary process. It’s not precisely in the moment in that sense. You ever felt the urge to return to doing turntable work? Do you see the kind of assembly that you do as being a different kind of process?
I was doing a turntable work back in the early eighties – pieces like Dong Il Jong and Shibucho. Frankly, I was completely unaware of any parallel movements which were happening at the same time in terms of hip-hop and the things that Grandmaster Flash was doing. I was in this fuzzy-headed classical new music world that just wasn’t really paying attention to that. Eventually I found out that this was going on too, and I really liked it. But at that time, I’d pretty much left that world and started working with sampling, working from a computer or a keyboard-controlled point of view. And, of course, there’s been so much innovation and there are so many great technicians out there now that it’s kind of scary to think about delving into that.
Is there any kind of music happening out there on the margins that interests you personally?
I think most of the music that interests me is out on the margins at this point. I’m kind of a weird case because I’m not a big consumer of music; I don’t listen to a lot because I tend to get more absorbed in making it than listening to it. I spent a lot of time in Japan and I’m pretty interested in some of the composers working there.
It seems to me that the material that you use is so carefully chosen that I assume that you must listen to stuff all the time.
You’d be surprised. Maybe because I don’t listen all that much, things really come out and grab me when I do. There’s also the idea of what I use as my musical material and sampling material. I never use electronic music for my sampling.
Is there a technical reason for that?
No technical reason, no. There are several reasons. First of all, electronic music is – almost by definition – already highly processed. Because what I’m interested in is using musical cognates for their significance, they have to be fairly concrete to begin with. Usually, I use things that are somewhat iconographic, classical music or pop music or something like that.
So the things you bring in bring their resonance with them….
They bring their resonance, plus it gives me room to change and the change has significance, and you can ascribe it to what I’m doing. If I were to start with something that was already abstracted, like the electronic music of Robert Normandeau, Michael Redolfi, Otomo Yoshihide, it would be meaningless because it’s already once removed.
You’ve worked with Otomo Yoshihide before. Your collaboration with him was interesting because in some respects, it seemed to me that you met in the center – you were both very interested in this business of selectively mining this set of shared cultural objects, taking that material and doing something with it.
That’s right. But what we did was the opposite of what I told you – we did what I don’t normally do, which is to use each other’s developed materials in furtherance of this kind of sampling project. But the only reason we did it – and the only reason it worked in my mind – is that if you went back to stage one, you would hear the original materials at the beginning.
Are you doing any collaborative work now? I suppose that using MSP now means that you can prototype instruments quickly. That’s bound to make collaboration a little easier….
Yeah, you can prototype instruments quickly and you have these terrific adc~ and dac~ input/output things that you can do, passing material, data, audio data and other kinds of data back and forth between computers. I haven’t done a lot of work with that yet, but it would be interesting to have two composers playing together where they’re networked, they’re actually passing not only audio data in and out, but other kinds of data through some kind of networking scheme. I’d be interested in trying that.
It would be interesting to see if there’s a way to do that that didn’t mystify the process of passing materials back and forth.
Yeah, hopefully it would not become totally oblique.
It seems to me that good process work is a little like the classical music of India, where the performance of a given raag contains the information you need to navigate through the listening experience – from the statement of the raag, to the entrance of a pulse and rhythmic structures, to its virtuousic elaboration. At the end, you’re in a position as a listener to appreciate what you’ve actually heard, because you’ve been led along the way.
Sure. Well, there is something very attractive about that. The metaphor of Indian music is not the first one that came to mind, but I can accept in terms of the elegance and the simplicity and the coherence in musical structure and form. But now I’m also interested in taking that and then maybe at a certain point destroying it altogether. I want to move from coherence into incoherence and then maybe back up from there…
…exposing people to the process by which things have been dismembered? Sounds like fun.
Well, stick around.