Archive for September, 2005

An Interview With John Eichenseer

jhno, a.k.a. John Eichenseer, is the culprit responsible for many of the plug-ins in the Pluggo collection. A musician and programmer living in San Francisco since 1994, jhno can be found DJing chill rooms in the bay area as well as experimenting with live collaborations in the diverse local scene. In this 1999 conversation with Gregory Taylor, jhno talks about his history, the minimalist musical tradition, and some of his favorite non-musical stimulus.

History

So how’d it all begin, anyway?

I started playing piano when I was four-years-old, lessons… my parents basically compelled all of my siblings and myself as well to take piano lessons, and it has stuck with me longer than any of them, I guess. I ended up playing piano all the way until high school where I started studying jazz with the local band director who was a jazz pianist. At that time I still really couldn’t play, I had no conception of improvisation or jazz harmony, and it wasn’t until I went to college at the University of Texas at Austin that I really started to understand jazz and be able to play it with any degree of authenticity or authority.

So, at the same time I took an early interest in electronics and computers – probably found it in my father’s vocation as an electrical engineer – and started working with electronics when I was a junior in high school. The first computer I programmed was a patch-bay Heathkit boolean logic sort of educational computer where you’d connect and-gates and or-gates with little cords that were each carrying five volts, wire them to switches and lamps, and watch your little logic operations play out. Then, my dad built a Heathkit 8080, and I programmed that in octal machine code until finally, when we got the big 64k board, we could load Basic from a cassette – and I just moved on from there. By the time I was in high school, trying to think of what I wanted to do in college, it was pretty clear that the two threads of interest were computers, on the one hand, and music, on the other.

So I elected to go to a school to study computers and started doing that at UT Austin, but by the time that I completed about three semesters I realized that if you stuck with a degree program long enough to actually graduate, you come out the other end really thinking like a computer scientist. The course work involved in as rigorous a discipline as that really changes the way that your mind works and it has a huge effect on the way you spend your time, and I realized, fortunately a little early on, that that wasn’t exactly who I wanted to become and that wasn’t how I wanted to spend my time. I decided to switch my major to music instead. I took a degree in music, a very general degree that let me study jazz and classical music theory and composition, and especially ethno-musicology and electronic music as well. The main reason I chose UT Austin is because I knew they had some electronic studios and I wanted the opportunity to use some equipment, because I never had much. I had been scurrying around with a couple keyboards and tape decks, just whatever I could get my hands on, but there was precious little access to equipment throughout high school and junior high. Eventually I was able to work in the studios at UT Austin and kind of cut my engineering teeth there, learning about mixing and recording.

There are people who claim that the kind of formalisms you have to do to make music and the formalisms necessary to handle a degree of abstraction that certain kinds of computer science require are similar – so we get the old saw that musicians make good engineers. I hear you suggesting that they might be at war with one another.

I think that they’re different worlds. There are a lot of computer or math people that are interested in playing music, and vice versa. But I would say that, generally speaking, in my experience in both of those worlds, the really brilliant computer scientists – or scientists of any sort – and the really brilliant musicians are generally mutually exclusive sets. I have found that the musicians that I have a great degree of fondness for tend not to be very computer literate, and the people that I know that are really good at computers, if I listen to their music, a lot of times it sounds like the kind of music that I would expect a computer scientist to make. That’s not always the case, there are exceptions. I think maybe now, in this modern age, those exceptions are starting to become more common. The problem is really, I don’t think it’s an inherent exclusivity of these realms or them being at war with each other, it’s just that in the human life span, and with the human size brain, there’s only so much time in the day, and only so much you can do with your life. Music is an extremely demanding discipline and it takes your entire life to get anywhere musically, and to develop yourself as a musician. With computers it is kind of the same way, to get into it very deeply takes a lot of time, and so it’s been rare that people have been able to do both in the past. I think it’s becoming more common that people can bring them together now simply because computers are accessible enough, and perhaps even music education, well… I guess music has always been accessible. I think that basically, people are able to spend more time focusing on developing both of those aspects within themselves and actually produce a satisfying synthesis between them. Maybe that’s a reflection of the state of technology – maybe that computers are becoming more accessible.

I suppose that every musician is a kind of transitional figure in that respect – probably every period of musical practice finds you suspended between one thing and another. You sort of set off navigating by dead reckoning toward a goal, and the winds of history or circumstance come up and blow you off course, and the sort of zigzag you make as you try to tack [to] the place you want to go… it just happens that now it’s technology. For not being an engineer, you’re fairly familiar with both the use of technology and tools and the interplay between the tools that you use in the works that you do.

Right, well I’ve made my living as a computer programmer ever since I went off to college, working my way through school as a systems administrator. When I got out of college I didn’t start being a musician, I started working for a software start-up doing things that had nothing to do with music, and then on the side I was playing in jazz bands and writing music for modern dance. So those things were very separate and that’s why I came here to the Bay Area to try and integrate them, which, as it happens, worked out better than I could have ever foreseen.

Music and Technology

What you’re saying, music and technology have always had a very intimate relationship… certainly currently the focus is on computers as a very pure and advanced instantiation of technology, of technology as a force in human history. I think you can trace relationships between music and technology throughout the course of history.

Sure. It seems to me that the difference there is that to the extent that any musical instrument is the result of an on-going community argument about how to convert some kind of force to make some kind of sound, there’s a real sense in which the argument that circles around, say, a piano is more clearly articulated, and more general than we find in terms of current technology. You could, in fact, build your own piano, if you wanted to. You could build a piano with nothing but single course of strings, you could change the material. Most people don’t and probably the reason they don’t is because we have a pretty good idea about what we expect a piano to do. Technological instruments have either not been around long enough, or the circumstances of their generation has not been such that those agreements have been easily made, to the extent that there are any agreements… the agreements about the instruments in that rack were made by the people that designed and marketed by them, not by you. You clearly made choices over one set of things in that rack over another, but it’s kind of not exactly like a piano in that sense, so the relationship is both more tenuous, it seems to me, in that lack of agreement gives you more space to work in that you may not have in quite the same way that you have with other instruments, or historically may not have occurred in the same ways.

Right. I think that what has happened that you’re getting at here, is that information technology has created a sort of quantum leap in technology which has facilitated the development of instruments much more rapidly. What I’m really trying to say is difficult to express: I think that if you look at technology as a phenomenon in human history, one of the recurring themes and perhaps the primary theme of technology is the quantifying of an otherwise continuous realm – it has to do with measurement – and basically the process of the mind making distinctions between one thing and another, and putting them into categories. If you look at other technological innovations, this is what they are doing, in different ways. For example, the written language took the continuous spectrum of human vocal communication and basically categorized it into a finite set of fixed symbols and phonemes, or letters or an alphabet that could be recombined to represent really not everything that was said between people but a subset of that. When you do that, the continuous realm of expression is mapped onto a new discrete symbolic representation of the whole, and suddenly you are able to do things that you couldn’t do otherwise. The symbolic representation facilitates activity in that realm in terms of communication: you can write things down, you can remember it, you communicate across great distances with more reliability.

You have ways to say what could be said, you don’t have words for everything, but you have a structure that either lets you do it, or you have a situation where you can mix phonemic symbols with sort of meta-symbols that describe other relationships. The reason that Egyptian hieroglyphics were really difficult to figure out was because that no one really figured out exactly what the schema of representation were until they had the Rosetta Stone.” The reason that Egyptian hieroglyphics were really difficult to figure out was because that no one really figured out exactly what the balance of… until they had the Rosetta Stone, they had this idea that you’d count the number of phonemes and you look at the number of characters that it’s translated into and you realize that some of those symbols must not be functioning as phonetic units, they have to do something else, so the question is what did they do and it was very difficult to figure out. But the idea is that the meta symbol allows you to make, to sort of make different distinctions that are not merely phonemic.

Well, language is probably one of the most complex examples of this kind of technology. There are other technological innovations that I can think of…

A real simple one is making a tape. The transfer of something from the continuous domain of a bunch of guys sitting in a room, to a resulting piece of tape which is a physical, discrete object, which maps some of what happens in the room onto the tape, then you have the physical thing that you can then alter, scramble, and manipulate. That’s a very simple simple version of it, but you get the idea.

Right. I hadn’t thought of that particular case. What I thought of was the case of digital audio, in which case the technological innovation is more clear, I think, because you’re taking the continuous wave format of pressure that is traveling through and quantifying it into discrete steps or samples that can be stored and manipulated in a computer.

Do you think that that insight depends upon the sort of mechanical transcription of the world in physical form first? Things like hygrometers, the technology of the 18th century that takes muscular movement and transduces it to recordings on tape. If you look at the French cardiologists of the 19th century – Etienne-Jules Marey comes to mind, there’s this thing in him about what we do when we do… that is, we take things in the world that happen too quickly or slowly for us to see, or too gradually for us to see, or at too small an increment for us to see, and we have a way of amplifying it so that we can investigate them. Now, he’s not actually using those records to manipulate the heart, but he can see something to it that he didn’t when he started.

Well, that’s a good example. And I think that historically all of those developments must have contributed to what we can currently do with audio, with computers. But they’re not at an abstract level, I think that digital representations of sound are not…

Is that abstract level something you find more… It seems somewhat at odds with your description about what interests you about people’s ability to do music without a lot of technical background. It sounds like the delightful part of what you’re describing requires…

Well, I’m only describing what we were talking about with this relationship between technology and music. To kind of finish my line of thought there, the point I was making is that I think that there is this recurring theme in technology, that these innovations occur where a continuous strata is measured or quantified. We talked about the example of language – I think that money is another good example as the technological quantification of human relationships, and I think film is an example of quantifying the continuous spectrum of light into either grains on a film or, eventually, pixels on a computer screen. More relevant to the current topic is the last one I mentioned which is digital audio, where you measure a sound pressure wave in terms of discrete steps that can be sorted into a computer and manipulated, and once you can do that the range of possibilities for manipulating, changing, analyzing, and synthesizing sound opens up exponentially. Developments in the process of working with sound have… their pace has similarly increased exponentially, and I think if you look at other technological developments, the other area that I mentioned where you’re measuring with language or money, you also see a similar exponential increase in activity and development that can occur once this technological step has taken place where you can now work on this representation of this system, instead of the system itself.

When you work on the representation of the system, what sort of history do you bring forward with you when you do that? What you’re describing sounds kind of like operating on the representation allows you to conceive of what you do as a sort of research project, you have a different kind of material to work on now, what happens if I do this…

I think it defines another dimension of reality in which can take place phenomena with as much subtlety and aesthetic beauty as any. For example, language may be an imperfect expression of meaning, and of interpersonal communication, but language itself, the medium of language has given rise to the phenomena of poetry and literature, much of which is completely reliant on the strata in which it’s conceived. The same with music. I think that if a technological innovation takes place… another good example is the development of equal tempered tuning systems that took the place of previously continuous and pure system of just intonation. Once you create a new system that contains a simpler representation than that which you were describing, then a whole new set of operations and abilities is presented to you. In the case of equal temperment, that technological innovation gave rise to music that could’ve never existed without it… for example, romantic music, impressionists, Ravel all the way up through jazz. The music of Bill Evans and John Coltrane could never have occurred without the innovation of equal temperment. The music that has happened since that innovation has been married inextricably to the equal temperment system in which it’s conceived. I think also that if you look at the development of music, the technological innovation of equal temperment – while it left behind much of the subtlety and purity of just intonation – caused a certain quickening of novelty and a far more creative development to occur faster than before, simply because you now had a sort of simplified system that was a representation that was kind of distilled from the pure strata that it described, and then with that, because of the way that the human mind works, with this simplified symbolic system you’re able to more quickly work with it, and so developments occurred more rapidly. And that’s what’s happening now with technology and with digital technology in particular, is that there’s a similar quickening of genuinely innovative development in terms of types of music and the kind of processing and synthesis that you can do in the realm of sound.

So how does technology enter your life? How does it change what you do or how you think about what you do?

I think that’s the thing that people would be well-served to remember: that these symbolic systems that we use – whether it’s equal temperment or notation, language, digital audio – they’re all describing something that is much more real and much more subtle, and I think that people who work with technology and music can sometimes get a little bit lost in the aspects of working with the technological tools. In my opinion, in my own experience, music is a realm that precedes the symbolic systems that we work with: it is a more fundamental and significant reality. In other words, when I’m working with music I try to be guided by music and not by technology. You asked if they were forces at war with one another, and I think that they are, in a sense, forces that are different from each other and relating. I wouldn’t say they’re at war, in particular, but they are kind of different worlds, they are different aspects of human development, in a way they’re sort of different spiritual domains. I prefer for my focus to remain on music – for that to be my guiding light, if you will. I’m trying to bring technology into the service of music, for the sake of music and the betterment of music and not the other way around, I’m not trying to bring music into technology to further technology. I prefer to do things for the sake of music and if I am working with technology, be it at my own studio, trying to develop my facility with technological instruments, or whether I’m programming software to make tools that I can use or that other people can use, it’s all to work with music. I try to be guided not by what is interesting in terms of the technology, but really by its utility for music and its implications for music.

Techno and the Minimal Aesthetic

So a reasonable, if somewhat waggish question is, given your background in this sort of wonderful, rich electronic tradition and the tools that technology affords you, your interests in serving music as music and finding yourself in the stream of sort of improvised musical behavior, why are you doing all this godless, soulless techno-crap?

Yeah, I would’ve been rather surprised, I think, even three or four years ago to hear then the music I listen to now. If I would’ve heard it then, I would not have heard it as music, I would not have understood, it would not have moved me, my ears have rather opened up to aspects of electronic music that previously seemed to me perhaps soulless.

Can you recover what those were? What do you think would not have been worthy of your attention? It didn’t swing?

What’s most often obvious, and most often criticized about a lot of modern electronic music, especially derived from dance culture, is its repetitive nature. This is a criticism that was leveled at minimalism as it emerged from the more so-called legit music circles, work from Steve Reich and Philip Glass and Terry Reilly. Some people, when they hear that kind of music, and myself too… it requires a different kind of listening that I think, to a certain extent, has to be learned, or it requires a frame of mind, a certain sensitivity to phenomena that are taking place in the music that are different than the kind of phenomena that happen in other kinds of music, like western classical music or pop music, on which most of us have been weaned.

Do you mean in terms of time scale or attention span or rate of change?

I think those are things that people identify as empirical elements of the music that differentiate one kind from another. But, they’re all hinting at some aspects of music that are more fundamental. Those parameters are important, I think, for example just time-scale has a lot to do with it. In a minimal piece, if there’s a passage that’s repeating indefinitely, subtle development of sound could be happening not in the notes themselves, but in the timbre of the notes, or the relative timing or pitch or volume relationships among those notes. So, somehow as a listener you have to make this leap of not just listening to the notes themselves, but listening to these other levels of activity that are occurring in the music, and I think that that’s something that takes a certain amount of sophistication to be aware of. But I don’t think that it takes an awareness of those things in order to be moved as a listener – I think that you can hear very repetitive minimalist music and be moved by it without having the intellectual persective to be able to describe all of these aspects that we’re talking about. There’s a certain sense in which those pieces, like all of music, are trying to relate emotional realities, or trying to describe relationships that exist in the world, and they’re doing it in a certain way, and I think that listeners of any kind can, by hearing this music, achieve an artistic appreciation of what it’s trying to express, whether or not they can analyze it and discuss all of the details of how it’s implemented.

What kinds of recordings or performances sort of helped you change the way that you hear?

That’s hard to say. If I try and look back on how I came to listening to either repetitive electronic music, minimalist electronic music or minimalist classical music for that matter… I mean, when I first heard minimalist composers in the world of new music, I had the same reaction – I just didn’t get it, I couldn’t hear what was happening, I wasn’t having a musical experience, I was just bored. And there is a lot of music that still has that effect on me, but if I look at how I came to appreciate that genre of music, and how I came to recognize the examples in it that I considered to be truly great, I think, on the one hand it was just hearing pieces that did resonate with me and that had meaning for me, which is still kind of a small subset of minimalist music. A lot of it just won’t work for me, it’s kind of a rare piece that will.

How about the decision to actually start making it? Did you want a way to come to terms with how you thought it worked, or was that something that you discovered by virtue of the technology, the tools you were using at the time, or… ?

Well, it’s interesting because you’re asking me this question having heard the records I’ve put out already, which I don’t consider to owe very much at all to a minimalist tradition, and in fact if you place them next to the other examples of electronic music which most people would place in the same category, I think in my music there’s more activity and variety than most, just because I have a background in jazz and in classical music and in other kinds of music where… I like to hear a lot of things going on, I like to hear complexity. The funny part is that in about the last year I’ve been moving steadily toward things that are much more minimal, it’s just that you haven’t heard any of them yet. So you’re asking about something that is a very real part of my current musical development, even though most people haven’t heard it.

I guess what I was thinking about, though, is the notion of locating yourself within the genre… well, let’s put it in this way: whatever your intentions, someone someplace drew some conclusion about the territory in which you work, that may not have been your intent, but it was the case, and my guess is that most people who know your name immediately would say “Oh, he does X”… we have a category of work. How did you decide to pitch your tent in that clearing?

I did not and I think that I never will because I can’t, and I’ve tried before, but it’s just not in me. What I mean is that I have been sufficiently influenced by music that I’ve heard, to make me want to make music that is in the same category… that is, if I listen to jazz, I’ll hear great music, and that makes me want to create jazz music, it makes me want to play the piano, it makes me want to write jazz pieces… and when I hear techno music that I like, it makes me want to write a techno piece… that music is similarly affecting and I love it, but whenever I’ve tried to do that, it has never worked. If I sit down and try and constrain myself to write a piece that’s using the elements of a real jazz piece or a real techno piece the way that they’re traditionally done, the way that their genres have been traditionally defined, I can’t compose in that way. I have never been a very good at constraining my creative parameters to a given genre. What I have been able to do is integrate all of those things as influences, and create music that is heavily influenced by specific genres and that owes a lot of debt to them for techniques and ideas and sounds that I’m using.

But I think, at least for myself, when I look at the music that I’ve made, none of it fits into these genres very well. Even the jazz pieces that I’ve written on the piano, it just seems to me that the harmony that I’m using… I don’t really consider myself a jazz pianist, even though I’ve written a lot of songs, and I play out, it just doesn’t seem that that’s my identity, because I don’t think that what I’ve done fits very easily into that genre, from my point of view. Obviously other listeners, and the music industry in particular, has to pile things into those genres for marketing reasons or just for people to have an understanding of what you’re doing and be made aware of it. Many creative artists reflect this sentiment, that their music transcends genres or cannot really be categorized, but some artists play well within the boundaries of a specific genre. Some people play traditional jazz – that is what they’re doing and they’re very clear about it. People that make house music are intentionally making house music pieces. If you are trying to put out a new 12-inch in a particular style, then you stay well within the established boundaries of what happens in that genre of music. If you step too far out of line, people that are really deeply into that culture will not hear it, it might sound interesting for some reason, but it won’t fit into that class of music. People have a lot of expectations, especially when it comes to dance music and its culture.

Are you speaking from experience?

Well, I’m speaking from dialogues that I’ve had with people listening to music and my music and talking about what those differences are. I’ve made things that have integrated elements of techno or drum and bass, because I’ve heard that music, and some of it has really turned my crank and opened my ears to new things. So, I’ll make a piece that has elements of those types of music in it and say, play it for a friend of mine – I’m thinking in particular of a DJ friend of mine, Lukas Girling in the U.K., who I worked with – and he would say that when you’re making music in one of these dance genres, the music that happens… basically, new and innovative music takes small incremental steps from what is already established. If you’re making a drum and bass track that is part of a particular branch of culture that’s listening to that kind of music, there’s only so much you can do in a single track that’s going to differentiate it from the rest, it’s like the track has to have all these familiar elements and then just a few things can deviate slightly…

Innovations being limited…

…and it’s almost like an expression of a regimented class system where people’s roles in society fixed and rigid. I guess my approach is a little bit more based in the spirit of jazz, and a spirit of free-thinking and directionless innovation where I am just making pieces that sound good to me and I don’t really care if they fit into a certain category or not, I just use whatever elements appeal to me. When I’m making a piece I really have the feeling that the piece itself is some sort of platonic form that already exists, that I’m trying to uncover. The worst thing I can do is try to impose restrictions of a given genre onto it… I think it’s an unfortunate, almost morally corrupt thing to make something smaller and more restricted than its fully manifested self, so I think that I’m always trying to hear the piece for what it is, and let it go in whatever direction it wants, not constrained by any guidelines of style or convention.

It seems like there is a situation in which a custom is accultured, in having these kinds of modes of production, consumption and listening, and that the kind of listening you do as you move is different than the kind that you do when you sit down. So, ideally what you do meets both criteria if it’s done well?

I guess. I’m not even a dancer myself to tell you the truth. I dance sometimes, but pretty rarely – so I don’t feel like I have as much of an understanding of movement, of dance as some of the people that are more inside this culture and making dance music. I don’t think I really make dance music, although I’ve seen people dance to my music – everything from people on a dance floor, to music of mine that’s been used by modern dancers for formal choreography. And so obviously it can work, but that’s not what I’m doing when I’m making music, I’m not thinking about the movement of a body. I guess I have a sense of rhythm enough now that I can hear the way that things swing, and I think I’ve become a lot more sensitive over the years to subtleties of rhythm and of things being in time or feeling good in time, and that’s grown, but it’s not really through moving my body. When I think about rhythm, I think more about the pacing of my mind, and the way that my thoughts occur. I listen to the internal sounds and communications happening in my own, in circuitry that is inside of me and the inside of my body and I think that there are these rhythmic relationships happening all the time within myself, and I try to be aware of them on different levels, consciously and subconsciously, and I think that’s where my sense of rhythm really comes from.

Guiding the Machines

Thinking about rhythm, I wanted to talk to you about the communal aspects music making one hears with your duo project “Spool” and the work you make for yourself. In some measure, there is a sense in which one of that kind of work is heavily moment-based and collaborative… I’m thinking that as you do more improvisation on the continuum, it’s more on that end, and then you find yourself in a situation where you essentially work alone, and in a situation in which technology extends what you can do in terms of allowing you to multiply yourself, and also extends your ability to make and manipulate certain kinds of noise. I mean you may not be able to play the contrabass, but you can come up with something that will function like that instead of having to find a contrabass player.

Well, if I wasn’t an electronic musician I’d have to be a pipe organist because I am very fascinated with this process of being able to create complete works myself. There has never been a generation of musicians that’s been able to do it to this degree, because it’s very recently that recording technology has come about and that electronic instruments and synthesis technology have achieved the degree of sophistication that they have now, so I feel very lucky in that respect, because now we can create pieces that are very musically or spectrally complete, that are very complex and rich, by ourselves. I am a pretty reclusive person, my process just happens to generally be very solitary – even in Spool I end up doing a lot of the engineering and production and mixing of the pieces by myself because John Ridenour lives in Chicago. It’s not because I’m a control freak, or an egomaniac – I love playing with people too and a lot of the music I make which I consider to be the strongest I’ve done has been due to the contributions of other people. When I play jazz I’d much rather play in a trio with a bass player and a drummer than playing a solo piano, because you can just do so much more. But there’s something in me that gravitates towards solitary and contemplative activity and I think that there is a place in my musical life where these pieces are conceived, executed, and created entirely by myself.

There’s a certain freedom you can achieve in that solitary frame of working that is just different from collaborating with others, and I think there’s some things about it that are worthwhile. I would hate to ever do just one or the other. I would hate to just be a purely solitary musician, and never work with other people in a group, because I think that they are both very interesting modes of working musically. I would like to keep exploring them. One other thing I have to say, though, is this idea that as an electronic musician, or even as a pipe organist… or even as a pianist, the idea that you are ever truly solitary is really an incomplete and spurious notion, because you didn’t build the piano, and even if you did you built it like another one… and you didn’t build the pipe organ, you certainly didn’t build all the electronic instruments that you’re using, the sounds that you’re using, things that you sample… you’re drawing on the richness of the world around you and things that other people have created, and so you’re still working in the context of community. You can never really get away from that, so even though I’m creating music by myself, often I’ll be working with recording sounds that have come from collaborations with friends of mine, and I’m using instruments that other people have made, so there really is this richness that can only happen by the contributions of many other living human beings. So I don’t want to give the impression that electronic music is really as solitary and isolating as it seems, because there are a lot of connections.

There’s a sense that there are some people – here’s the plug part that gets edited – in which some people probably encounter the work that you do in terms of signal processing devices that you’ve put together, somewhat idiosyncratically I might add, for Pluggo, in the sense that there are people who probably encounter you live by virtue of the recorded material you make, and now, by virtue of the tools you’ve invented, to make things that strike you as interesting. I’m curious as to the point in your musical development where this change occurred. First, your background in computer science means that you can do things that the average consumer of electronics made by other people can’t do. But what is was that made you start making things that you couldn’t acquire…

Well, it’s a pretty recent development in my musical slash technological life, I think… in the same way that I said before that I’m a musician before a technologist, I’d rather be guided by music than technology; I’d rather prefer that to be my focus. I think that my musical output is a more full expression of myself and what I find interesting than what I can do with software technology. Be that as it may, and that said and disclaimed, I’ve been surprised and rather delighted to find that in the software that I’ve written I still see my character and creative expression. I see the same voice in my software and technological output as I do in my music. I look at them and I think the same person created these things. I like that because it indicates to me in a very personal way that technology has the capacity to be as creative and full of character – and idiosyncrasy as you say – as something like music. I have this same feeling when I see software that other people I admire have written. Things that are very idiosyncratic have an artistic and aesthetic integrity to them and a richness and a beauty that are the hallmarks of a creative person with a sense of vision. The reason I think this is heartening is that this is not always the case; in technology and software there’s a lot of people making things that just seem as soulless and empty as it is often slandered, either tongue in cheek or not, like your previous question to me.

Anyway, to get more to what you are talking about, I think that I was drawn to work creatively in the realm of technology because of its capacity for self-expression, and also because if I look around at the technology that is available, I find it wanting, I wish to contribute to it and bring into being things that I think should exist, or ideas that I think should exist, or ideas that I think should be expressed in this realm. Basically, what it boils down to is that I always think that things aren’t quite weird enough. In terms of technology, there are a lot of straight or expected conventions that are played out. What you can do with musical technology or sound processing tools and what I find most interesting as a consumer of them is that they are truly innovative, or that they make large leaps or do things that are extraordinary. So that’s what I’m trying to do in technology as well as in music, is show what is possible, to try and find genuinely new things. Not all of them will last – not all of the music I make will, I think, stand the test of time, and I can’t even predict what might. Not all the software I make will, but I think that some of it will, so I have to just basically make everything I can think of that strikes me as interesting and put it out there and let it play itself out in the culture at large and see what rises to the surface.

I think that there’s an additional relationship occurring which is that if I can make interesting innovations in music technology, it just happens that those are the tools that I use to facilitate my primary expression in music, the creation of music and sound, and so by participating in the process of the tools that I use I’m enabling myself to go further and achieve a broader range in the music that I create as well. Whereas if I was not participating in this level of creating, my own tools would be restricted. It takes a lot of work to get those two processes to really feed back into each other in a useful fashion, because music feeds back into technology as well. The things that I do with computers are informed by what I’ve learned about music, and what’s happening in my musical life, and so I think the challenge is that they really are two different worlds. While I’m writing software or putting things together on the computer, that is not the same mode emotionally or cognitively as when I’m making music – you have to shift gears a lot and if you’re trying to be a musician making technology or vice versa, you have to start to be aware of this process.

If you start working with technology you have to be careful that it doesn’t sweep you away, because you start to get really excited about things, and if you’re becoming a true geek, that means you’re probably going to spend a lot of long nights writing code and playing with little systems. That’s great, but I know a lot of people who have gotten lost in that and lament its effect on their music making. If you start working on tools indefinitely, then your process of creating music and working within your purely musical world can sometimes be left behind. Like I said, they overlap a lot and back into each other, but they’re still somewhat separate, and when you’re working on music… when I’m working on music properly and working in the world of musical ideas, trying to shape things according to the sound, I’m not developing tools simultaneously, I’m using what’s available to me. There’s an extent to which you can do those at the same time, but at least for myself I consider them to be separate processes, and I have to constantly direct a balance between those so that neither one completely overshadows the other, because if you leave something behind it will atrophy. If you get out of the technology game your skills will deteriorate and become obsolete, and if you stop playing music your chops will deteriorate, and your momentum on your path as a composer… so it’s really quite a balancing act to try and maintain these separate lives, but it’s also a pleasurable challenge.

Look. Listen. Read.

Okay, three things.

Okay, so we have three things to listen to, look at, and to read. Is that right?

Yeah.

Okay, look at is maybe the easiest because that’s the furthest away from the core of my being, just because I’m a little more into language and music, so those are harder. Probably my favorite piece of computer-based art or graphics, visual art, is Scott Draves’ “Bomb,” which is a multi-platform, cellular automata-based graphics program that produces organic moving imagery based on a variety of algorithms that are recombined in a way that I think is rather ingenious. Scott’s become a friend of mine and we’ve worked together a little bit, and I have a great appreciation for cellular-automata in general. I just happen to think that his program is the best instantiation of it so far, from an aesthetic point of view, and I think that just by looking at something like that you can gain all sorts of insight into the way the world works. Other than that, I would look at the structure of plants in the real world. I also feel like I gain a lot of insight about things from the way that trees bifurcate at their branches, and if you look very closely at a flower or a tree then you will see encoded into it just a logical structure that if you understand, you can make relationships between that and music, and between that and so many things about the way the world works. Just try to imagine the DNA sequencing, and the intra-cellular processes that created the patterns that you’re seeing, because it’s all being generated out of these very simple replicating units that occur in all of life. So I like looking at plants.

These are in no particular order, I guess. The other… I would say that all of the elements are pleasurable to look at. Anybody can stare at a fire or ocean waves endlessly, but I like looking at the sky a lot, and that’s probably also because I fly paragliders – I have a new and much deeper appreciation of wind and meteorology than I used to. If you don’t want to fall out of the sky, it helps to formulate a model of what’s going on. Just the motion of fluid dynamics is incredibly fascinating, whether it’s the sky or watching liquids combining, it’s kind of a very similar phenomenon. I just love to see things swirling around… the chaos of dispersion… so wave behavior in clouds and in water is particularly fascinating. It’s great when you combine them like flying maybe 1000 feet above the coast here in San Francisco, and you’re flying through the air and seeing the clouds above you, the sun shining through them, and at the same time you can look down and see the patterns of waves crashing into the cliffs in the ocean.

Okay, what do you listen to?

That’s the hardest of the three, because I’d be incredibly hard-pressed to define three recommendations out of the entire world of music, so maybe I should just not even touch music at all, and talk about other things I listen to. For example, one of my favorite ongoing activities is listening to insect sounds, or other animals that make periodic, and continuous sounds – especially frogs, birds sometimes to a lesser extent, but frogs and insects really draw me in most readily. I’ve recorded a lot of insect sounds, I keep thinking about pieces I might be able to make from them. I don’t know, I’m really fascinated by the variety and subtlety of the noises that converge in nature. If you’re sitting there listening to a field of cicadas and trying to hear the patterns… because it’s not just noise, they’re communicating with each other, things are happening in their world, and you’re just hearing the sonic representation… and trying to make conferences of adjunct stories of what really is happening, what’s behind the sound.

What’s the last old thing you bought?

Old music?

Yeah. Older than 20 years.

Well, that Marvin Gaye CD is older than 20 years, but that’s not really old and it’s a little bit of a tangent for me. As far as old music, I would say Bach… the Indonesian Gamelan music we were talking about earlier, I have quite a fondness for that. There’s so much indigenous music that’s great – I really have a predilection for the Middle East and Eastern Europe, as far as folk music goes. My drummer friend Bryan Bowman turned me on to a CD called Gypsies of Rajasthan, that’s great stuff – I love music from that area of the world. I love the duduk which is an instrument from Armenia (and Turkey). I got into it from hearing the famous Armenian duduk player Djivan Gasparyan and I even bought a couple of duduks and am trying to figure them out.

Did you really?

Yeah, I have two duduks and a box of reeds. The problem with those things is the reeds… at one point I could play, and I got some good tone. I recorded the duduk on one track of mine – it’s actually one of my better tracks, at least judging from people’s response to it – where after the introduction basically in the beginning of the song before the beat kicks in, I play this little simple line on the duduk and I just love it because I was able to get this big warm sound. The duduk is an extraordinary instrument, it sounds very different in real life than it does on tape, because on tape, like these recordings of Gasparyan…

They’re big, huge, dense, wet spaces.

Yeah, it’s the most timbrally expressive, warm wind instrument that there is, but in real life it sounds much smaller and rather insubstantial, and that’s because of the “proximity effect” of the microphone – the low end becomes emphasized and, as you say, bigger than life.

I think I like the idea of an acoustic instrument that is smaller than you think it is.

I’d like to hear a talented musician play one live. I’ve heard myself, it’s not exactly the same. I still have to get out and hear that instrument sometime. At the same time, I would like to play it more, but the problem is the reeds: you pay like 15, 20 bucks a pop for the suckers and they’re all different, and they end up drying out and getting screwed up.

Where do you get them?

I think they’re generally just imported from Armenia. I bought one of the duduks from Lark in the Morning. They have so much stuff, and they sell reeds too. I’d rather just travel to these countries. I’m sure you can just buy reeds there for 50 cents – of course, if you’re a serious reed instrument player you make your own reeds, but I don’t even know where you get materials for this stuff and it’s just a whole path that I haven’t been able to pursue.

Okay. Something to read?

That’s good, that excuses me from thing number three to listen to, which might be silence, or your own brain, anyway, so that’s a good call. To read, I think I’d have to first identify a book that we were discussing earlier today, which is Harmonic Experience by W. A. Mathieu, because I think that’s the most informative and important book about music ever written – at least that I have seen. I haven’t read all the books there are out there, but I got a music degree, and have seen enough to know what’s been expressed about music. It’s hard to write about music and read theories about music, and to analyze it, and to come up with things to communicate to other people, because so much of it is inexpressible or ineffable, and the people that are sensitive to that don’t want to diminish or cheapen aspects of music by trying to narrow them into inadequate forms of expression by talking about it. I feel that way myself, but his book I think goes further into explaining what is really happening with music and why it is interesting to us, especially from a musician’s standpoint, making music. I think he has more to say on the topic than any other source that I’ve come across. I was simply surprised to read that book after having studied music for almost all my life and gotten a college degree at a decent university, and I started reading that book and almost immediately it occurred to me that this is what music is about, and why didn’t anybody tell me about this before. What it was to me was a validation of everything I was doing in music, because I think that when you learn traditional Western music theory, it seems very arbitrary – and in fact, it is. They are telling you, “here’s the twelve notes of the scale, and here they are and these are their names, and these are the kinds of chords you have” – and a good teacher is also going to be saying: “of course, you know we’re just talking about it, describing, and what you really need to do is play it, and listen to it and have this experience, and that’s what real music is, right” So you do that, and then it’s back to the analysis.

It just seems like it’s a different world, all these arbitrary symbols and descriptions – a system that you make, and then from that comes music. That’s fine, but I think eventually this viewpoint is a little bit disheartening or unsatisfying. What happened with me when I read Mathieu’s book is that I realized there is a reason that music is this way, that our systems of harmony have developed over time in this way, and that’s because physical objects resonate in a certain manner, and they resonate with each other in relationships that are intrinsic to the physical world in which we live. The harmonic series is found in nature and the interaction of vibrating objects, which behave according to certain rules, and what he does is talk about those rules, which I already knew, but he traces the relationship between the way that physical vibrations interact and the music that we’ve made. I knew that, for example, musical intervals were based on the harmonic series. I didn’t know how, I just knew that there was a harmonic series, and then there’s these scales that we have, which are related, but not exactly the same. What he does is tell you why. Other people have done that too, but I think that the gestalt of his explanation is more complete and satisfying than anybody else’s that I’ve heard. [His book] draws a more complete picture of the relationship between basically just intonation and equal temperment than any other I’ve seen.

What else do you read?

I guess Philip Dick has caught my ear lately. In particular I like Valis and The Divine Invasion, a couple of his later books which I think are among his best. Everything he has written is pretty interesting – I’m fascinated by his writing style, and what he has to say. I think he was a very deep and mystical person who had an understanding of the world that is extraordinary and unique. I don’t know if I would recommend him to everybody. There are certain people to whom I recommended him immediately, but I don’t think that kind of fiction is for everyone. I guess if I had to recommend a book most broadly it would be Monkey: Folk Novel of China. It’s a translation of a story which is more like a collection of stories about this mythical stone monkey that comes to life. It encompasses a broad swath of Chinese mythology and Buddhism and Confucianism all thrown together, with a lot of humor – generally just a thrilling book to read. Very fun. But at the same time it has the same epic scope, or the feeling of significance as other spiritual literature like the Ramayana from Hindi literature. It is taking on these heady topics, it has plenty of depth and philosophical significance, and it’s also very light-hearted. Monkey is a lovable character.

An Interview With Andrew Schloss

With a set of experiences that includes playing with Tito Puente, touring with Peter Brook’s theatre ensemble in the 70s, and recently playing percussion with Rickie Lee Jones for the opening of the Experience Music Project in Seattle, it’s clear that Andrew Schloss has been all over the map for the past 30 years. In the mid-80s, shortly after discovering the radio drum, an electronic instrument created at Bell Labs, he went to IRCAM where Miller Puckette and David Wessel introduced him to Max. The young program’s power and flexibility bowled him over, and since then Schloss has been working with Max to make the radio drum respond with the same subtlety as a traditional percussion instrument. On a warm summer day at his home in Seattle he and Ben Nevile talked about the challenges that a performer faces when trying to take advantage of the enhanced possibilities of computer music.

Where is music going?

It might be interesting to talk about the way that we’ve treated music in the past, and how music has changed. For many, many years music was so special, because you couldn’t record it…

Yeah, and it’s only a hundred years or less…

… and now? For most chart-topping, popular music, a CD is better than a performance. It’s backwards.

For all these millenia, when live music was the only source… I don’t know. Now we’ve had two or three revolutions in music that some people thought would already have killed it. First there was radio, then there was recordings… and still people listen to music, they go to concerts, they buy records, they learn how to play instruments… so, things have shifted, but we still have a musical world that we live in. Now it is true that, say, if you look a hundred years ago, in North America, for example – what percentage of the population played the piano? It was high! If you wanted to listen to music, you played music! And now, probably one out of a hundred people play.

It’s really decreased, has it?

Oh yeah. In 1910 – I just happened to have read some of these statistics – the production of pianos in the United States was astonishing. They were producing hundreds of thousands of pianos a year, because it was like having a stereo. Now if you go to a neighbourhood department store, you see fifty varieties of these cheap boom box stereo things. That’s what you buy now, because it costs a hundred bucks. In 1910 you went out and bought an upright piano.

Is it interesting maybe that we’re using personal stereo equipment – turntables is what I’m thinking of, of course – as instruments?

Yeah. I didn’t think it was going to happen. I’m amazed by it. I wonder where it’s going. I don’t want to take away from it… it’s an art form, it can be an art form.Learning to play the violin is definitely a lifetime thing. Learning to play turntables is not a lifetime thing, although some people I guess are getting pretty good at it.

This harks back to the idea of virtuosity. Would you pay money to see DJ Foo, who’s astonishingly good at this shit? Yeah! I mean, look at this guy, he’s doing amazing stuff. Yeah, that’s virtuosity. That’s going to see something that you couldn’t so yourself. At the same time, some of the stuff that I’ve seen my students doing… you know, it takes a few weeks. People like to have things they can really sink their teeth into… I think. I’m not sure about this. You know, we have two hundred cable channels, people have less and less time, and in a way they’re pretty lazy. Maybe they’re not willing to spend the seven thousand hours that it takes to learn how to play the cello.

But the first people who played a cello – or whatever distant relative of the cello came first – were surely unskilled as well. It’s only through tradition and time that an instrument’s intricacies are learned.

Yeah, of course. Maybe we can make these instruments easier to play. Max Matthews has talked about this in terms of making instruments play themselves. For example, let’s say that the instrument played the right notes for you, and all you had to do was control the nuances of it. This is like his version of the radio drum, which is a baton. That’s really fun, and it may be a really nice device for people in their homes. It might make music more accessible to people. You probably wouldn’t pay to see somebody else do that, but you might do it at home for your own enjoyment.

You can always look at all of these things from positive and negative standpoints. For example, a music teacher or performer might say “this is sick. These people think they’re playing music, and they really haven’t learned how to do it.” But the other side is that you can say “look at all these people for whom music is more accessible.” It is true that if you pick up a cheap Casio keyboard that will play for you, chances are you’re not going to stick with it long, because… well, it’s kind of stupid. But then again, your chance of quitting piano lessons is high because… well, it’s really hard.

But it’s the hardness that makes it so special!

Exactly, right, sure. The fact that you have to work. This is why I wonder if it’s going to go away, or what. The effort… what’s different is that in the past you didn’t have any choice. If you wanted to make nice sounds, it was hard. Whether it was scraping a bow over strings, or blowing in a hole… there was no easy way to make music. Now we have lots of easy ways to make music.

So what do people really want? I don’t think we know. I think we just throw the stuff out and see what people do with it. I think it would be a sad thing if kids learned how to play turntables, and they say “why the fuck would I bother learning how to play the trumpet? It’s way too hard, it sounds shitty… I can’t even play drum and bass on the trumpet. What’s the point?” I think that would be really bad. For one thing, at some point there would be no music left to source!

Understanding

I keep trying to get back at this issue of understanding. How do you understand music? I think you understand it by playing it, I really do.

More than just by listening to it?

Absolutely. If I’m in a classroom, and there’s something funny about a certain instrument, whether I can’t tell if it’s real, or I can’t tell how it’s played, or if it was done by a computer, or something, I will look around the room and I will find a person who plays that instrument, and ask them, and they’ll tell you right away. They’re not just listening, there’s a corporeal thing. They’re playing the music when they’re listening to it. If I’m listening to a symphony orchestra, I can tell you all kinds of shit about the percussion, and you’d go “percussion? I didn’t hear any percussion.” I’m there listening to the sounds that I’m familiar with… I’m familiar with they way that they’re generated.

I think there may be some biological thing – not to get too profound here – but I know that they’ve studied bird songs, and it turns out that there are some theories about how birds identify song. One of them is this really funny thing, that they’re actually identifying the physical method of generating the sounds rather than the sounds themselves. To some extent that might happen with us as listeners. When you listen to music that you’ve never played, and have never had any concept of playing, it’s not that you don’t enjoy it, but there’s something…

You’re missing a dimension of the music. It’s like having one eye closed and losing your depth perception: you still take in everything, but your brain lacks a whole level of understanding.

Oo, good analogy. I think about this with my own instrument. What if it got to the point where the radio drum was the instrument that I wanted it to be… and let’s say there’s a kid who’s eight years old and wants to learn how to play drums. Do you give him a little Remo djembe to bang on, or do you give him this radio drum? You know, I think maybe you should give him both, but to not give him the physical drum seems like a mistake.

Even if the radio drum has developed just as much subtlety and dynamic feel as a real drum?

Maybe. I’m not sure about this. When you play a drum, and you hit it, and you notice that it sounds different with all these different ways of hitting it, and you learn how to make the drum sound, it’s pretty deep. It takes a lot of physical effort. I just think that it may get to the point where the radio drum is that good, but I think it’s still a different thing that you would not want to lose.

Will people continue to play orchestral instruments in three hundred years? Plenty of people predict that there will be no symphony orchestras, because they’re all going bankrupt as it is. People don’t want to pay, for some reason.

We have so many entertainment options. Wham! Eight thousand TV shows.

There it is, any time you want it. Most of it’s shit, but it’s very seductive. I just wonder about the whole idea of music education. What is it? What do you learn? When you’re eight years old, you probably don’t go to lectures on music theory. That would be stupid. You start learning how to play an instrument. I think the coordination and the mental discipline are really important.

This sounds a bit like the discussions that people had when calculators began being used by kids in schools.

Yeah? Well, it’s true – people can’t do arithmetic very well any more.

But maybe I don’t need to memorize my thirteen times table.

You still need to know how to do it for those times when your calculator doesn’t work!

Right – you don’t want to become overly reliant on the technology. The denizens of the plastic planets they visited in Star Trek taught me that. There’s no doubt, though, that technology becomes a part of us. Maybe the way that we make music is changing because we’re changing along with the technology.

It could be, it could be… I just wonder. God, if I wonder, I can’t imagine what my colleagues must think! Think of where I teach now, at the University of Victoria… think of the clarinet teachers! What are they thinking about all of this? Luckily for me, I teach computer music, so I’m not going to lose this argument, but at the same time, I’m worried about it, because I do believe that people need to play instruments. I also find that of the students I’ve had, the ones that do the best are often the ones who had a command of some instrument. If somebody comes in who is a really smart engineer, and they want to do computer music, they often sit there like… what do I do? What are the raw materials?

Okay, here I am in the studio, and I know how to use the tools. Er… how do I make music?

Yeah, exactly: how do you make music? What happens is that you give a student like that a defined project, and they’ll do it because they’re smart programmers, but the problem is that they don’t know where to go with it. That’s where, whatever it is, this musical intuition…

It’s a language. You have to find a voice, and then learn how to speak it.

Teaching

Having taught all sorts of people, musical and non-musical, you must have had some pretty interesting students.

Oh, yeah! I wasn’t always teaching composition, you see. Sometimes I was just teaching a point of view, really, which, if someone came in from cognitive science, or computer science, or physics or something, they could take it in their own direction. A bunch of cool people have taken my classes. Scott Draves, for example, the guy who wrote Bomb, was in my class at Brown, where I taught from 85 to 89. I’m still friends with a lot of my students from that time. Brown just has a lot of smart kids, and I think that made it possible to introduce them to this stuff and just let them go with it in their own direction. It’s a little harder to do that here in Victoria, ironically because I teach in the School of Music which is basically a conservatory. In contrast, at Brown, which is a liberal arts school, there were only about 20 music majors in the whole school, and that meant that most of my students were from other departments. Still, some of them were very accomplished musicians even though not music majors.

For example, another of my students at Brown was Lisa Loeb, who’s a bit of a rock star these days I guess. She was clever even then, and she was writing really cool songs, and she was learning how to do overdubs and stuff… I think all I taught her was a little bit about tape recorders. The point is that they would come in from all these different departments, and then I would try to arouse their curiosity… and they were very open to that. There can be a problem in music schools in which the students erroneously believe that if they learn anything besides their instrument, they’re wasting time. I refer them to Yo Yo Ma, math major at Harvard and superb musician. Not a normal guy, though.

I teach classes in Victoria that some of my colleagues think are a waste of time. “Music, Science and Computers” is an example. It’s similar to the course I taught at Brown and UCSD many years ago. Some of my colleagues think that it’s a waste of time because it’s not designed for music students. My answer to that is that I’m teaching people, not necessarily musicians. I don’t know what these students are going to do for a living, but I do know one thing, they’re going to understand the world of sound better, and that’s useful, interesting, and even at times inspiring.

How many of our music students are going to end up as professional instrumentalists? It’s a scary thought, and I’m almost afraid to voice it, because it’s so terrifying – I mean, what are we doing in these music schools? I would even fear that the provincial government could say, look, what do you need all this money for? How many oboe players do we need in the province of British Columbia? I’m certainly not going to say that – of course I believe it’s very important to have music schools – but man, it’s a scary prospect with all of these orchestras shutting down. Like I said before, though, sometimes not having command of an instrument made things difficult.

Another example: I went to a lecture recently by an ethnomusicologist named Charlie Keil. He was talking about his students who can’t play clave. It’s a Cuban rhythm, the basis of a lot… the students can sort of do it, but they can’t really do it. They can’t keep it up. He’s really distressed by that. He’s distressed because he thinks that these people are handicapped in some profound way. He finds that if they can’t do it by the time they’re in the university, they’re fucked. You can’t teach it to them. He tried at first to be nice and keep these people in his drumming ensembles, but now he kicks them out. He says they just screw everybody up, and they never learn. He really didn’t want to be a pessimist, but he just found that if they couldn’t do it on day one, they couldn’t do it on day one hundred.

Some people are born without rhythm, I guess.

But are they born without rhythm, or… okay, maybe one out of every two hundred thousand people is born without rhythm, let’s say. But sadly, maybe one out of every three people – at least in the US – although born with a potential sense of rhythm, never develop it. It’s a cultural thing. If you go to Cuba and try to find someone who can’t do clave, you’d have to search, and that person would have to be pretty screwed up. This also has to do with that physical, corporeal thing. Keil also talked about “head bobbing.” When he listens to music, his head moves – it’s good, it’s a physical thing. He was saying that one of the reasons his head bobs is that he identifies with some aspect of making the music, whether it’s playing the drums, or singing, or something. I had never really thought about that.

I bob my head to a lot of artificial music.

Hmm, right. Is it some imaginary source, or… Even what I teach… I had a student this year who I think was a sociology major. He really didn’t know much about music, but he was super enthusiastic, and he really wanted to learn about sound editing. He was good at the things he wanted to do, but he was totally ignorant about other things. He didn’t know anything about new music, contemporary music, western music, he didn’t play an instrument… I found him really fun and interesting to teach one day, and other days he was really annoying, he was so totally clueless about certain things. But he just went out there and got a job at some fancy movie studio in Vancouver, and now he’s doing sound effects for TV shows, and he’s probably happy and making money. I think that’s wonderful. In contrast, I think there are plenty of graduates of the school of music who are now selling records at the local record store. I wouldn’t want to do that.

No, that seems like a huge waste of talent.

Aesthetics and the Social Milieu

At least as musicians they’d be able to point the customers towards good music.

Well, maybe. This idea of how you appreciate music… is it true that musicians appreciate music more than other people? I personally don’t listen to music that much.

Why not?

I don’t know. There are lots of non-musicians who listen to ten times more music than I do. There are various reasons for that. I really like to do it more deliberately – I don’t like to have music playing in the background or walk around with a walkman on my head. Another reason is that especially in the last few years, I have a very strong emotional response to certain music, and I find that it’s unpleasant sometimes – it’s more emotional response than I necessarily want to have. So I turn the music off.

What do you think about the idea that we’re moving more towards music being like a painting, a work of art captured at one point in time? Obviously as a performer and not a studio artist that’s not the direction you’re moving – you’re still standing up in front of the crowd and drawing – but especially with electronic music, a lot of it is…

… built, constructed.

Yes, with meticulous attention to detail.

I think that’s fine if the method of construction is interesting. If I sit here and write notation, it’s not music until a performer plays it. If I’m working in a studio with Pro Tools or MSP or whatever, and I’m making this very careful and constructed thing, it’s a finished product when it leaves my studio. I guess to me the viability of that relates to the intellectual property question. A lot of people will do it out of pure love, but those people who are trying to make a living, if they can’t sell their work, it’ll be a problem. Performers will still have the option of performing.

The practical implications of this change still have to be sorted out, but somehow musicians will continue to extract money from their fans. I’m wondering more what you think of the philisophical change, I guess. I think this is the key difference between turntable-based music and the rest of pop music culture. There are some turntablists whose performance is based on their dexterity. There are others – the majority, I would argue – who approach things more like an art gallery: here’s a nice painting, here’s another nice painting, now I’ve got three nice paintings playing at once…

One of the extraordinary things that has happened in the aesthetics and social milieu of electronica in the past ten years is that… well, just a few years ago, John Oswald made a record called Plunderphonics, which he got sued for. It was intended to be a poke in the face, which it was! I thought it was cute, funny and clever, and interesting, and philosophically viable. I taught a section in my class based on Plunderphonics, and until recently it was exotic to plunder existing music in this way, and it was useful, because it was a way to get even inexperienced people making music, because anybody can do it.

This year it suddenly dawned on me that young people are doing this all the time. It’s like nothing now, it’s what everyone does! They take the music, move it around in Pro Tools or Acid or whatever… and it’s what all of these kids are doing! Aesthetically and sociologically, something really changed between John Oswald’s record and now. People don’t think twice about the fact that all their sound sources are other people’s copyrighted material. That’s not even an issue. They’re not even thinking about making their own sounds to manipulate. The whole world, their CD collection, and their mp3 files, that’s their paint brush. It took me – you know, thick skull – until this year to realize it. How did this happen?

The technology is cheap… I guess it was just a logical step. There it is… why not use that material?

Sure. It’s rich, it has a beat… When I first discovered modern electronica I thought, okay, I could see how you would make the stuff. Use a drum machine, make the rhythms, design the sounds… that was sort of interesting, because I am interested in new techniques, and I’m interested in what’s going on, too. What I find very interesting is that not a single one of my students this year was actually making those beats. They were just using beats that somebody else made!

There are also people who make their own sounds and beats. Laziness manifests itself in sampled loops.

It’s more appealing to me to generate your own stuff.

Yeah. It’s more like art and less like theft.

Yeah! I know some very erudite computer music composers who were doing similar things way before the DJ craze, but I didn’t realize… for example some serious composers who were “digesting” other peoples’ music for fun and profit. That is to say, they might take a Mahler symphony or something like that, load it onto their hard drive, and then write very complex, non-realtime csound programs that would process this symphony into something totally different and completely unrecognizable. Of course, it had some connection to the original, because that was the sound source, but there was no way you could get this guy for copyright, because there was absolutely nothing recognizable at the end of the process. That was weirdly prophetic. They were using these sound sources that were already complex orchestral sounds, and then created the csound “meat grinder” to run the source through. Nowadays, this is commonplace in techno circles. In fact, as I just saw in Berlin at the late-night “off-ICMC” clubs, it is a very hot application for MSP these days.

All the rich timbres of classical instruments…

…but radically modified! It’s hard to synthesize sounds that are as interesting and complex as orchestral instruments, so why not start with them? When I first saw MSP, I thought it was a great synthesis environment – which it is – but now I think it’s an even better processing environment.

New Techniques

Can we talk about “computer extended ensembles”? In one of your papers you describe how in your joint performances with David Jaffe the “boundary between performers is like a permeable membrane”. I think it’s fascinating that you can push what you’re doing onto the other person, and that they can push back.

Yeah. The analogy is like in bluegrass music, there’s this trick where one guy reaches around and plays the chords for the other guy’s banjo. With musical instruments in the MIDI paradigm you can have this complete flexibility in who’s talking to the synthesizer in what way. MIDI isn’t that complicated, there aren’t that many streams of data. The thing that makes it more interesting, like let’s say with Max… if you have an interesting Max patch between the two players and the sound generators, then everything becomes, as we said, like a semi-permeable membrane between the sound-generator and the players and the algorithms themselves. What I play into the system may not directly affect the sound, but it may affect what the other player can do. For example, if David’s doing pitch bend, but I have control over sustain, then if I make the sounds that he’s playing staccato, the pitch bend won’t be audible anyway. He’s dependent on me to enable the sustain so that you can hear the pitch bend.

I remember you describing another interesting technique…

“Note stealing”?

That’s it.

I started doing it with a jazz pianist named Jeff Gardner, when we were in Paris together. I also did it later with David Jaffe and his pitch tracking Zeta violin. For example, the violinist is playing pizzicato, or if it were a pianist he’d be playing the MIDI keyboard, and I’m “stealing” the notes. So, the person who’s playing the live instrument is feeding me notes basically, and then I have a Max patch…

Right – the notes go into a buffer which you can access and play back with your drum.

Yeah. So what’s weird about it is by hitting different parts of the surface of the radio drum you can traverse this buffer and actually not go up and down in pitch, but rather go backwards and forwards in time. You can do really cool things with the stuff that the other person has played – it’s a form of improvisation that you just couldn’t do any other way. Let’s say you were a brilliant jazz musician and you had a perfect ear and everything. If somebody played a really fast figure on the piano you could play it on your saxophone, and you could riff on it, but what you couldn’t do is “digest” it in real time and keep flinging it back at the other person in infinite permutations. I like doing it on the radio drum because you have real control over the rhythm. When it’s in the buffer you can play it note-by-note or you can be in what I call continuous mode, where the position of the drum sticks continuously trigger the computer, so you just have a constant stream of notes. The technique gives really interesting sounds.

The buffer stays constant and is only changed by his playing, correct?

That’s right. If my partner does an arpeggio and fills up my whole buffer, then that’s all I can play. We could have done it another way, but we like certain constraints.

In Uni, the piece I’ve been working on with Randy Jones, we’re performing images and sound together, and there’s some similar things going on. The whole idea of where are we going with images – is this a fad, or is it the beginning of a whole new set of performance possibilities? I think it is something that’s going to keep progressing. The last time people really did this was in the 60s during rock concerts when they did light shows, and then it faded away…

…except for the Pink Floyd die-hards who like to get stoned in planetariums. It’s also been a big part of rave culture.

[laughing] That’s true, and that’s something I haven’t been tracking, that’s true. Now I don’t know exactly how they’ve been doing them at raves, whether they’re like light shows…

They’re typically visuals on a big screen. The most complicated ones use computers, but I don’t really know much about them.

Randy has been working on this software called Onadime that allows you to talk to these image streams, whatever that means. If you’re “listening” to MIDI – say, a performer sending out a MIDI stream…

…every single event can be used to trigger a visual phenomena?

Right. For example, in a piece I did with David called The Seven Wonders of the Ancient World, the original version uses a Yamaha Disklavier, and the keys physically move. That’s like an animation, it’s a visual thing, people can see the piano keys moving. When you take the piano away and you play a synthesizer, which is what I do sometimes in venues that don’t have a Disklavier, suddenly there’s nothing to look at and some of the impact goes away. That’s why I first talked to Randy about doing an Onadime patch for The Seven Wonders. It’s sort of like a fantasy on the motion of the keyboard – every single MIDI event triggers a one-to-one correspondence with some image. It’s cool, it’s like a super-duper piano mapping, but abstracted and multiplied. How far can we go with this? Is it a fad? Is it distracting? I don’t know! I think there’s value in it.

I don’t think it detracts from the music in any way – it certainly adds something to a performance.

Sure, for us, but there are cases when it could detract. For example, if I were listening to concert music… it was written as concert music and the composer thought it was concert music, and then somebody made an Onadime patch and projected it behind the musicians, I could certainly see that in some cases as being distracting. The music was conceived as an entire experience. If you put this crazy stuff behind them, who knows? I’m most interested in things that are designed to be performed visually. In the case of the Seven Wonders, our mission was animating the keyboard and visualizing the music, whatever that means. I hadn’t thought about it for years, and then last year I went to a conference on visualizing, and what I realized was that there are all these different worlds that I hadn’t thought about as being connected at all. There are a whole bunch of people doing different versions. The idea that there’s some way of visualizing sound… I think we can go a lot further with that. I’m just beginning to experiment with it.

The performance that I saw you give in Vancouver had so much going on in the visual aspects, I can’t really even remember what the sounds were like. I was especially fond of the twirly things [makes hand motions].

Those twirly things were, of course, supposed to be something else.

When Things Go South

We ought to talk about that – with highly technical instruments like yours, often you get up on stage and the equipment malfunctions, or a bug shuts you down, or something. What do you do?

Well, I get really upset. It’s just not fair. It’s really a level of stress that… I mean, some things can’t be helped. You can get up on stage and there can be an earthquake. Okay, fine. But the amount of time that something goes wrong with this computer music, and the amount of time I’ve seen very experienced performers, very thorough… like Jean Claude Risset, Mari Kimura, who’s not as technical but certainly very professional – they get up on stage and then they’re just hosed! It’s like, now what?

If you look at somebody like George Lewis – if his computer breaks, he just kicks it off the stage and plays the trombone for an hour. He’s a great player. Mari could do that too if she had to; I mean, she’s a great violinist. But that’s not why we’re there. We’re here to see this piece that involves technology.

The question is, how far do you go to protect yourself from disasters?

Yes. Do you, for example, have a complete duplicate of your entire set-up on stage? Do you really go that far? That’s pretty extreme.

It’s what U2 and Rush do.

But they have roadies, huge trucks… they’ve got people to back everything up!

To me this is not a trivial matter at all. I’ve suffered too much when my shit didn’t quite work. As a professional you get off stage, and you smile, and people congratulate you… but at the same time, it’s so frustrating to have all this stuff prepared and have it not work. If you’re extremely sophisticated technically you’re more confident because you can fix most things. But even the most brilliant programmer will occasionally run into something they can’t fix. I’m not technical enough to solve all possible problems, especially on the spot when I’m nervous and I’ve got a concert.

So if you’ve been preparing for months, what kind of things go wrong? It’s incredible what can go wrong! We’re not just talking about something inconvenient, we’re talking about something profoundly destructive, the feeling that you’re at the mercy of these machines. I imagine that someone who’s really technical and sharp, like Adrian Freed for example, would be more likely to troubleshoot an issue on the spot that I would, perhaps. However, he’s not a performer; if you put him on stage, get him scared enough, and add on all the other issues that performers deal with, well, at some point we all fall apart.

I remember once watching the wonderful composer and scientist Jean-Claude Risset on stage. His piece simply didn’t work. Who walked up on stage? Miller Puckette. David Zicarelli. On that particular evening, the audience was full of experts, and many got up on stage and couldn’t figure out what was wrong either. What was wrong? I think it may have been a bad MIDI cable or something. There are too many things that can go wrong, and debugging when you have an audience waiting for you is a whole different experience than debugging in the studio.

You’ve hit a nerve here, because I have paid in blood. Some of the things can’t be helped – there’s a finite possibility that a disk drive will fail at any time, for example. What’s much more likely and much more irritating is that the fucking programmers were careless, and that is inexcusable. If I added up the number of hours that I fucked around with extensions in the Macintosh OS, I could be a concert pianist if I traded those hours in and played the piano instead! Why am I sitting there selecting and deselecting extensions? I mean, that is so stupid! There’s no doubt though, we’ve all been there. One wrong extension and you’re dead.

MSP and Max are very robust, don’t get me wrong. But, like everybody, my computer crashes randomly. It’s very frustrating. We need computers that run for three years without crashing.

We have them in traffic lights and pacemakers… and control towers.

That’s right… and keyboards! Keyboards don’t crash. Most of the time I’m inspired to keep going despite all the headaches. The only time when that slides is when… when I either think there’s no remedy, or when I’m just so furious that I just can’t stand it.

I get to that point pretty easily. I’ve got about twenty minutes of debug inside of me before I get frustrated and look for something to throw against the wall.

I’ll spend twenty hours on something if I think it’s worth doing. The kind of stuff where it’s mindless, where you might as well be a monkey, where your thought process is irrelevant, and not only do you have to blindly do it, but also wait for the computer to reboot every time… Your cycle is very slow, and you can’t really do much while your computer is booting. You can go pee or something. It’s like a diabolical system that’s designed to keep you from getting anywhere. It’s not enough time to read a book or go for a walk, but it’s too long to stare at the screen and wait…

Constant Modification

Part of the problem with crashing, and also the difficulty with acquiring virtuosity, is that you keep changing your instrument. If you were to use the same radio drum patch for ten years, you’d have it all sorted out, and it wouldn’t crash.

Yeah. We’re constantly modifying things and stepping on ourselves. I think that’s inevitable. I think that technical people tend to have this disease more than musicians. Everything that can possibly go wrong in the physical domain is multiplied by a million when you’re using computers. I have this friend named Jaron Lanier, who you might have heard of…

Sure. Wired magazine. The “virtual reality” guy.

Yeah, he coined that phrase. Anyway, Jaron used to say that if you want to be good in computer music then you have to be a hick. What he meant by that was that if you’re one of those people who, every time a new synthesizer comes out you buy it, you’re never going to learn how to play it! You have to hold onto these older guys for a while and really learn how they work, and if they don’t have the newest features, that’s okay.

I think that’s played out in more… can I say popular electronic music circles? The instruments that have come to the forefront are old analog instruments, and even more recently FM synths are kind of the rage.

I didn’t know that! I’ve had a bunch of those. I think physical modeling will be a huge thing. It just hasn’t happened yet.

Modeling of real instruments?

Yeah, and extrapolating from the real to the unreal, but still using physical models.

Like maybe modeling a super drum that you’re hitting with an 8000 pound stick?

Yeah, something like that. Taking the physical parameters outside the normal range. Physical modeling for me means being able to explore timbre space. I mean, as a percussionist I’m looking for whole ranges of sound that need to be controllable from an instrument that’s something like a drum in an integral way… so that if you’re moving away from a central point, there’s some meaning to that, that it relates to the sound. That’s so important for improvising, because when you’re improvising you can’t sit down and spend three hours figuring out where your sounds are coming from. You can’t do that. You have to be in a perceptual space that you can traverse that makes sense. Once you’re on stage, there it is, it’s your world that you play.

I guess for me, what I’m really most interested in is getting to the point where I can jam. Simple. I haven’t really been able to do that. All the musical situations where I have played my high-tech instrument were either with other people who know what it’s like, like David or Randy, or they were with geniuses like Chucho Vald&eacutes where I worked for six months on my own and then played for an hour. It was great, but the ratio is too high.

It must have been a thrill to work with an instrumentalist of his calibre.

It was different, boy, I’ll tell you! Chucho Vald&eacutes, you know, is one of the greatest pianists living today, there’s no doubt about it. The idea of playing with him is terrifying. You know, you can get together with one of your weirdo computer musicians and say “oh wait a minute, I have to work on my sound,” but when you sit down with Chucho Vald&eacutes you don’t screw around trying to…

As Jeff Gardner used to say when I was screwing around with the computer, “it don’t mean shit on the bandstand.” You know? I don’t care, don’t tell me about your computer, let’s just play! To be able to actually to walk into a room and pull out your mandolin and play… I suspect most of my colleagues are not at that point. I know what ingredients I need to get there. I need a drum that works a little bit better, and I need a physical modeling environment that gives me a sonic physical world to be inside of. If you’ve got physical models of percussive things, pieces of wood and pieces of metal, and you arrange them in a reasonable way, depending on the musical context… I think it would be a huge step forward for me to be able to jam.

Physical Legacies

Do you think it’s important for us to pattern our electronic instruments after acoustic instruments?

I do think it’s important. When I first went to CCRMA in ’78 I was annoyed when people tried to imitate real instruments. I thought, what’s the point? We can already play real instruments. I want to make sounds that have never been heard before. That’s valid, but what Chowning would say to answer that question would be yes, that’s okay, but we need to develop the subtlety and the craft of the sounds. In terms of my own work, I think that the constraints, whatever it is you’re pushing against, are very liberating. If you always try to expand your horizons, then you never play. At some point you have to say I’m done, this is my instrument. The intuition about music is based on making music. I really feel that conventional instruments are an inspiration, and always will be. I’m not sure why… maybe it’s because we’re physical animals and we live in a physical world. Art cannot be simulated, I like to say.

A lot of it would have to be that we’ve had real instruments for thousands of years. The violin, for example – we know a lot about the physical techniques that coax great sound out of it.

This relates to an article that David Jaffe and I wrote on the future of musical performance. If you’re Marvin Minsky, or you’re somebody who wants to write for Wired magazine and stuff, it’s very easy and fun and goofy in a way to talk about getting rid of your body, but me… I like having a body.

Well, the body is what our brain is about, right? The brain protects our body, it gets our body to feed ourselves, it’s using our body to make more bodies… I think it’s okay for you to like having a body.

Thanks. So at some point, okay, maybe you can download yourself to a hard drive or something. I think for a forseeable time we’ll have bodies, so I think the dance thing is really interesting and important, and the physicality of playing… the history of musical instruments is based on physicality. Maybe we’ll get past that, and that’s something that I think is worth thinking about, maybe that we’ll evolve musically beyond any correlation with physical instruments.

I also think the social aspect of music is not to be forgotten. I think a lot of people into techno forget about the social aspect. Maybe not, because I mean, raves are definitely a social thing.

I think they used to be more so.

Oh? I went to one thing that was kind of like a rave. The musicians were all on stage with computers, one of them with a keyboard – there were four of them – and for the life of me, I could not tell who was playing, if they were playing, if it was a tape and they were just moving… to me, that was a bad performance. What was interesting was that to their peers, it was not a bad performance. I was really surprised! Their peers didn’t seem to mind that there was no apparent correlation between what they were doing on stage, and what I heard.

In this way I’m sort of reactionary in that I believe in cause and effect from a performance standpoint. The virtuosity question is in relation to cause and effect too. I mean, if there’s no cause and effect there can’t be virtuosity. You have to see someone doing something, making something happen. It may be a juggler juggling steak knives, or it may be a guitarist, or singer… if there is no cause and effect, then there’s no reason for virtuosity to exist. This has already affected me in the negative sense, where I’ll do something with my high tech stuff and somebody will come to me and say “well, I can do that! I can wave my arms like that!”

It’s true that some of the things I do anybody can do. Why is that? Well, in some cases it’s because I spend a whole bunch of time thinking about how it would be possible to do what I do, and that’s part of what I consider to be the piece. In Seven Wonders, for example, there are certainly things that anybody could do. The Shepard tones at the end of the seventh movement where the piano is playing octaves… all I have control over is the shape of the amplitude envelope of the descending sound. So, for example, if I had a heart attack and just collapsed during the performance, it would play perfectly. The point is that in a performance with technology, there’s always going to be variations in the extent to which the performer is absolutely making something happen.

So, will electronic concerts become more physical, or will people wrap their heads around a new form of concert where the visual cues are absent?

I think it’s too early to tell, and I don’t know how many years, or decades, or centuries, or millennia it will take to know whether our concept of music, which is based on the physicality of conventional musical instruments, is a historical relic of the fact that that’s all we could think of doing – banging on membranes, scraping strings and blowing in holes. That’s all we knew how to do, so that’s our concept of music! Maybe we really will get totally past that. I don’t know.

An Interview With Bob Ostertag

Bob Ostertag is a music school dropout who has since performed all over the world and has collaborated with the likes of John Zorn, Fred Frith, drag diva Justin Bond, and the Kronos Quartet. In this interview he describes his creative process and what inspires him to design his technological instruments.

Visual People

Tell us what you’re doing now.

Well, let’s see… I’m touring my Yugoslavia Suite, which is a multimedia thing for video and audio and live performers that uses a combination of Max and MSP on one computer and Imagine on another computer. I’m preparing my second CD of solo improvisations which will all be done with Max and MSP and game controllers. I have two new quartets… one with Fred Frith, William Winant and Joan Jeanrenaud, and one with Joan Jeanrenaud, Theo Blechmann and Denman Maroney. I’m touring my trio Pantychrist with Otomo Yoshihide and Justin Bond. Let’s see, I know there are some other things in there… oh! I’m doing a project with Joan Jeanrenaud and Jim McGee, an artist in El Paso. Actually, that’s the next thing on my plate, that Joan and I will go to El Paso to do this recording with Jim. Then I’m going to teach in Slovenia for a few weeks in September.

Where are you touring the Yugoslavian suite?

Well, I just came back from… we did it in Austria, at Steim in Amsterdam, the Nancy Festival in France, in Lyon, Victoriaville in Quebec, at the Futuresonic Festival in Manchester, at CNMAT, and in Winnipeg… so generally around.

You attempted to take it to Serbia first. You ended the comments in your diary with a discussion about the intentions you had, beginning with work whose content was so explicitly political and bringing it to the people where it was. You talked about the difficulty of finding the space in which the kind of interaction that you wanted could take place. How do you think that doing the work, or performing it, has changed as a result of your going there? Did that change the way that you organized what you did, or did it change your attitude about how you presented things?

Well, I was going to make a third movement to it that was going to be based on videotaped interviews with audience members after the piece was performed in different parts of the world, and I dropped that idea. So that’s probably the biggest change. There were actually two challenges that really grabbed me about performing that piece in different places. One was that there was so little political space available in the former Yugoslavia. It’s like people didn’t even have the space to think about it. They would just have a sort of visceral reaction to it. But the other problem is the problem of working with images, as opposed to sound. This is the first piece I’ve ever done that uses images as a central element. Actually, that’s not true… I don’t typically use images.

But you often collaborate with people who emphasize stage performance or visual imagery.

Sure. But there’s something about using documentary imagery. The way I think about it is this: we all hear sound differently. If I sing a note, or play a note on a trombone or whatever, you’ll hear it slightly differently than I’ll hear it. We’re all different people, and we bring our own histories to how we perceive things. But we see images really differently, much more differently than we hear sound. If you took images like the images that I used in that piece, and you show them to people in former Yugoslavia, where they’ve been bombarded with those images for the last ten years, and they know them inside out, they probably are familiar with every image I use, and can identify the people in it. Not only can identify the people in it but the place it happened, and they probably know why that was an important moment, and why somebody would want to take a picture of that, and they’ve probably thought about that moment inside out for the last ten years… and then you show it to somebody from the United States, and they don’t even know what country it’s from. It’s pretty hard to imagine that you’re going to make a piece that will work in both places, and all the other places I’ve taken the piece. So, that’s a hard one. Sure, I’ve done things that are sort of the sonic equivalent, where I’ve used documentary audio that was quite politically charged, but it’s still different.

Found material, material whose content is explicitly identifiable with a given circumstance, seems to be at the center of much of your work. You’re doing something with both visual and audio material now, and you’re saying that the two are really different. I think many of us would see visual images as more public, in the sense that we can get them from someplace. Your point of view is that even though that’s ostensibly the case, they’re more immediate. They’re public all right, because I can get them from forty places, but it’s a given image at a given time at a given place, and when I go to Yugoslavia and show that image, something different happens.

It’s true. I just think that people are primarily visual people.

That’s a great thing to hear a composer say, isn’t it?

Performance Anxieties

In the department of redundancy department… I just did another piece called “Between Garbage and Science” that was a theatre piece, and that’s the first time I’ve ever worked with an actor on stage. That was really a difficult experience. There was a filmmaker, Pierre Hebert, and an actor, Baltazar Lopez, and myself, and we were all onstage, and we really wanted to make a piece where the three elements of actor, film and sound were sort of equal. It was really hard. People perceive with their eyes first, I think, and if you give them something to look at, it’s very hard for them not to perceive the sound as an accompaniment of what happens in front of their eyes.

Do you feel that that’s a difficult thing to manage when you perform live? For a very long time you’ve been involved in the creation of the equivalent of your own instruments. When an audience goes to a concert hall and sees a grand piano, unless it’s played in a very unusual way the audience brings a certain set of expectations… ways in which a piano player transduces small motor coordination into noise. Seeing a performance with a game controller means that the audience doesn’t have those things. Does it ever concern you, for example, that they’re distracted from the sound you’re producing by trying to figure out how Bob does the trick?

That’s one of the big problems of performing electronic music, of course. I’m sure everybody who would read this interview on the Max web site has thought about this stuff. Actually, the game controllers are very new for me. I’m actually new to writing my own software and so forth. For ten years I used an Ensoniq keyboard… I did all my stuff on a keyboard I bought at the rock and roll store. But I don’t have any keyboard facility at all… for me it was just a bunch of buttons. I thought about that a lot. When I first started using it, it felt very disconcerting to be sitting on stage in front of a keyboard, and then an audience would come in and expect you to play this keyboard, and then you’d be using it as a bunch of switches, and display none of the facility that people would expect you to display when you sit down at a keyboard. For a while that really bugged me. Then I got so used to it that it stopped bothering me.

I played that thing for ten years, which was another deliberate choice of mine, because I think in electronic music people are in such a rush to get the latest thing, and to upgrade their system, and to get something faster and with more voices, that they never actually learn to play anything. I think particularly if you’re going to perform, then you have to develop some kind of… not virtuosity, but you have to learn to play something. That takes a long time – you can’t learn to play something in a few weeks or a few months. So I stuck with the same instrument for ten years even though there were much newer things that had more buttons and more whistles. I got to the point where I think people responded. They were sort of surprised that I wasn’t playing a keyboard, but even though I was just hitting these buttons and scrolling through menus and stuff, I was comfortable enough that… I sort of had it in my bones.

You developed a virtuosity not in the keyboard end of it, but in the Bob Ostertag bank of switches.

Yeah. I think it’s something very physical, and something that has very much to do with your body. I think you have to be comfortable putting your body into the performance. I got to the point where I could do that, and I think people responded to that. After a long time I finally relaxed about it. Now I’ve switched to a powerbook and a joystick…

Has the problem returned?

Oh yes, absolutely. I’m going to have to work with this for quite a while…

Well, basically you’ve said that’s why people have trouble with electronic music. You’ve actually done the upgrade, and you’re now faced with the same problem that everybody who upgrades constantly faces all the time. The only difference is that you go a decade between re-inventions instead of six months.

Right. An interesting thing about game controllers is that almost everybody has used them at some point. Not everybody, but certainly many of the people who come to my concerts have used them.

It’s a much more common thing.

Which is the same as a keyboard – most people at some point in their life have sat down at a keyboard or piano and doodled around, or have even taken a few piano lessons as a kid or something. So when you sit down in front of a keyboard, there’s a resonance with the experience that you’re having. It’s similar with joysticks, actually… people know, well, you can move it this way and that way and twist it, and hit those buttons…

It seems like their familiarity might allow them to connect more immediately with what you’re doing in terms of content, because there’s less mystery about it. Probably a little more mystery than a piano, but in the same sense they sort of know that at some point it’s not going to burst into flames, and you’ll have to actually touch it for something to happen.

You know, it took me a while to get the bugs worked out of using the joystick, so while I was doing that I did some shows just sitting on stage with the laptop. I actually did two shows in proscenium stage theaters with full theatrical lights where I was just sitting on stage…

…and how did that feel?

It felt really… clerical, like I should have been doing my taxes or something.

Bob Ostertag, CPA, on stage.

I had no problem with the music, I thought the music was just great, but it felt really strange.

Was it your sense that the audience responded that way too?

Well, I made a point to ask people, and people said that it was jarring at first, but then they just got into the music and stopped watching me.

I think there’s a whole techno/post-techno scene where that’s pretty much the rule. Four guys sitting at tables in front of a laptop while you’re supposed to dance. It’s pretty dislocating.

I thought about, well, what I should do is just walk out on stage and then when I start to play, turn the lights out, and then turn them back on when I’m done, because there really wasn’t anything to look at all. I’m not satisfied with that either, because people want some kind of connection with you if it’s actually a live performance. I’ve also been querying people after the concerts where I’ve used the joystick, and even though I don’t feel like I’m really playing it in the way we talked about – I don’t feel physically relaxed, I don’t feel it as an extension of my body or anything – people responded very differently than when I was just sitting at a laptop.

I would imagine that, particularly with the Yugoslavia suite, there is a sense in which the identification of that particular tool with the kind of computer mediated game version of the tremendous violence of the visual images must pack some structural wallop. If you were interviewing people about death squads it would be different. The use of that particular tool would have a very different meaning.

Well, in that piece we actually put a video camera on my hand with the joystick, and we mix that image in with the other images. So, we actually try to use the full weight of that image. In the first half of the piece I’m essentially playing a computer game that we made… it’s like I’m bombing Yugoslavia. That’s actually how I initially got interested in using the joystick, because I wanted to have one to fly this plane in Yugoslavia Suite, and then once I had one and got it working, I thought I could use it for other things.

Electronic Motivations

You’ve described your feelings about being physically present when you perform. I’m curious about how you came to using electronic means in the first place. At the time you started doing it, it was certainly much harder to do than it is now. What was it that led you to perform instead of writing pieces for Joan Jeanrenaud, say?

I didn’t start out with this perspective. Actually, there was a time when I was so much younger where I actually wanted to remove my body from the performance, that was one of the appeals of electronic music.

Is that because you were shy or uneasy about being physically present?

No, I think it was more… I was really obsessed with sound, and I was really obsessed with listening. I mean, we could psycho-analyze me on many levels about the decisions I made at this particular point in my life…

Then I’d have to charge you, Bob.

[laughs] At one level anyway, I was really obsessed with sound.

Was that obsession with sound explicitly connected to the collection of its meanings in the world as your work is now?

No.

So it was pre-political, sort of.

Yeah. So, first I got obsessed with Jimi Hendrix, and then I got obsessed with electric Miles Davis, and then, you know, I went from there. Since I started out playing guitar in garage bands, I really wanted to move away from that into this… sort of what I imagined as a terrain of sound. I had this very naive and youthful idealistic view of what electronic music could be.

Do you think that the percentage of improvisation and open-endedness you do now is greater than when you were in your garage?

No. Pretty consistent.

I’ve heard you say before that you feel that’s a strong way to characterize your work – the improvisatory nature about it.

Well, some of it is and some of it isn’t, you know? Yugoslavia Suite is about half and half. This thing I’m going to write for Joan is going to be completely notated. It’s rare that I actually completely notate something. But then again, I think of my CDs as compositions, and those are entirely fixed. You know, it’s recorded onto a CD and there it is, burned right into the [knocks on table]… whatever the stuff is that you burn it into on a CD.

The exciting high register philosophical term for that is a concrete particular. Isn’t that a great phrase? So your CDs are concrete particulars.

[laughs] When I was in high school in the garage it was pretty much half improvised and half written. I had a nice band. I played guitar, and we had a drummer, percussionist, bass player, oboe, English horn, two trumpets, and a piano.

That’s a pretty big band! You wrote all your own material?

Yeah, the oboe player and I wrote all the material.

I would have guessed that you grew up with piano lessons and then basically discovered that going to electronic stuff gave you some kind of control and input into things that traditional compositional practice didn’t.

No, no, not at all, not at all. I wasn’t really given any musical encouragement at all. My family wasn’t interested in it. I started out playing guitar in bad rock and roll bands and then started writing my own stuff, and put together this band… the orchestra in my high school was good, so I went through the orchestra and asked the first year of every instrument if they wanted to play in a band. That’s how I ended up with a band. Then we got these Heathkit fuzztone kits, so we had all these little electric gizmos for the trumpets and the oboe. I started adding more and more pedals to my guitar, and pretty soon I was more interested in the pedals than the guitar.

The devices for the horn… that sounds like a Miles Davis thing.

Yeah, that was the idea. I was really into Miles Davis. I still think Bitches Brew is one of the absolute seminal musical experiences.

So why and how did you come to embrace electronic technology? And how did you come to combine this interest with pretty passionate political engagements and questions of identity?

Why use electronics? Well, electronics are rare, and they’re everywhere, and they’re one of the most provocative things out there. If you’re fourteen years old, and you’re starting to play rock music, one of the first things that you encounter is electronics. If you’re somebody like me who doesn’t have much natural ability or skill in the lot of the conventional parameters of music, like pitch and melody, and rhythm but have an affinity with sound, and you feel that your ears are good at grasping sound and manipulating it, then electronics is certainly where you go… particularly if you have an electric guitar, and you start buying fuzz pedals and wah wah pedals. You start wondering how those little gizmos work. You start thinking about how to record, and then all of a sudden you’re into mixers, and yeah… it’s a completely natural progression.

You know, I’ve never had any studies, so… [laughs] I’ve had a very, very limited amount of formal study, and fortunately the little bit I had was with people who encouraged me. I went to Oberlin for two years, though not as a conservatory student. Because I was only there for two years and because I wasn’t a conservatory student and was taking electronic music courses as a college student, I actually didn’t have any of the course requirements that the conservatory kids had. I actually completed their electronic music course the first year I was there, because that was all I took… which was a funny thing, because the guy who ran the electronic music department was criticized for that. I thought I should have been given a prize or something, but the Dean told him it made the program look bad if a student could do it in a year.

You’re probably one of their best failures, then.

That whole conservatory was just the embodiment of that… I really remember thinking that to me, if you were going to teach music, then the fundamental thing that you should be teaching people is that they have something unique to say through sound, and that they should trust that and go with that. The whole message of that conservatory was the exact opposite of that. The whole message was that you probably don’t have anything to say at all.

…and since you don’t, it’s best to learn how to reproduce the work of others who did have something to say.

Yeah, and they convince you of the Herculean task ahead of you. It’s just awful. So, yeah, I have very little training. I always sort of train myself for the project at hand. The things I know how to do are the things I’ve been required to do for the projects I wanted to do, and I don’t know how to do much else.

Politics

Do you find that your interests as a composer are directed by the tasks that you set for yourself given your ideological involvement, or are they tasks which come to you? In other words, has your understanding of the power structure of the world come from the investigation of making pieces?

No.

You’ve brought those kind of passionate engagements to bear on the tools, or as you’d say it, the few things you do know?

Well, to explain better what I was trying to say… I just did this piece, Yugoslavia Suite, and it’s the first time I’ve used video. I didn’t study video, and I didn’t take any video classes, and I’ve never really been particularly interested in video… but then I had this project I wanted to do, and I thought, well, this needs video. So then, I got into video. When I did Spiral, which used a text by David Wojnarowicz, where he described his own dying process and used the metaphor of turning into glass, I wanted to play it on glass instruments. I’d never built instruments before, but I got into it because I wanted it for that specific project. When the Kronos commissioned me to write a string quartet for them, I actually hadn’t written notes on paper since high school. So I thought, okay, I guess I better get back into writing notes on staff paper! So I really try and take it a project at a time.

Did that project come to you because of content? In the case of the Kronos project, did you choose the background and context for All the Rage, or did they approach you about something with that content, or was that something that you chose to do?

They heard my piece Sooner or Later, which is a pretty politically loaded piece, and they wanted me to do something like that. They wanted me to do something about rainforests, and I didn’t want to do that. First of all, it’s important for me to say that most of my work doesn’t have an explicitly political theme… it’s just a little subset of it that does. But when I do it, I try to choose themes that I have some sort of direct and personal connection and engagement with, and not just look out at the world and decide to make a comment about the hole in the ozone layer or something. So I didn’t want to do a rainforest piece. I actually had this idea to make a trilogy of pieces about grief, anger and joy, and Sooner or Later was the grief piece, so I wanted to do one about anger. Then there was this riot in San Francisco that I was a participant in, and took my tape recorder to and recorded… so then I proposed to them that I make a piece for them out of the riot. They liked that idea.

Did you ever do one on joy?

I haven’t gotten around to the joy piece yet. Joy is harder. I’m doing this series with documentary source audio, and I haven’t really found one that I would use for a joy piece that wouldn’t be cliché. The first two pieces, I think, use pretty exceptional audio source material. It’s not so easy to come by that stuff. I’ve got my eyes out for something to do the third piece, but I haven’t found it yet. I had a recording that I wanted to use… I went to a prayer meeting of a Christian sect in Silicon Valley… it’s quite remarkable what they do. They have these prayer meetings that are similar to prayer meetings where people would talk in tongues, except instead of talking in tongues, they laugh. They call it Holy Laughter, and they go up to the front, and the priest puts his hand on their forehead and they fall down giggling. I wanted to get a recording of that. I thought, you know, given the history of what Christians have done in the world, falling on the floor and laughing was really one of the better… [laughs] So I went and made a tape of it, but I ended up not using it. The tape wasn’t as good as I wanted it to be, because I felt too intrusive making the recording at the meeting.

When I was in my early 20s I got really into politics. But in much the same way that I do these pieces, it was just a project at a time, and I certainly never studied anything, but I started volunteering for this and that, and of course, there’s a circle you get into when you’re in those kind of political groups. If you’re freelance, and everyone else is working for a 9-5 job, and they say “who can take the film to the developers tomorrow?” , you’re the one who can do it, and you get sucked right in. Pretty soon all I was doing was organizing, and the music had just disappeared. It disappeared for ten years.

But your entry into politics, was there any connection with your artistic work?

Yeah, actually I went to Nicaragua after the fall of Samosa with the intention of making a record of Nicaraguan music for this record label that Fred Frith and I were running at the time. I decided that music was not the most interesting thing that was happening there, and I stopped playing music for about ten years. Eventually I did study some stuff about politics, but that happened a little later. So I always just try to take things a project at a time, and trust your instinct and your intuition. I don’t know how else to do it, really. I never made a decision to stop playing music, for example. It was more that I made a decision to go back to it. At that point I was pretty far into politics, and I hadn’t played music for a long time.

What do you think brought you back to it?

The short answer is that after several years I discovered that there was not as much political space for somebody like me in the Central American left as I had imagined when I first got into it. I also discovered that my connection with American culture and with music was maybe deeper than I imagined when I got out of it.

In some respects, even though it took you a lot of time, that’s a fairly valuable insight. Most people spend much of their lives never being able to get more than the vaguest sense of what’s important to them.

Fred Frith was actually the only friend from my musical life that I’d stayed close to all through those years. I’d been telling him that I was thinking about playing music again. He called me up one day and said “are you serious about it?” I said yeah, and he said “can you be in New York for rehearsals in a couple of weeks?” I said “I guess!” Then all of a sudden, there I was in Fred’s band, and we were off on tour. I hadn’t thought about electronic music for almost ten years. I had never heard of midi. I had never heard of a sampler. I had to go to the rock and roll store and find an instrument to play, and buy it, and read the manual… [laughs]

Was it dislocating to go back?

It was really dislocating! It was an extreme Rip Van Winkle experience. The technology had completely changed, my friends had completely changed… when I left music, John Zorn was this totally unknown guy I did gigs with in his girlfriend’s apartment for audiences of four people. It was utterly a shock to discover that he was a star. All kinds of things.

Why Max?

The pieces that you’ve decided to do are connected to the tasks that you’ve set for yourself. The things that you know are the things that you need to do to do the thing that you want to do. Why on earth would you use Max?

Because I had been using the Ensoniq keyboard for ten years, and I felt like I had mined it. I felt like it was time for something new. It was funny, you know… I hadn’t kept up on new keyboards or anything, so I went shopping. I didn’t find anything interesting to buy. It’s funny… when I first started in, quote, electronic music, close quote, it was really a pretty obscure thing to get into. It was pretty much assumed that if you were into synthesizers, you were into experimental stuff. All the synthesizers that were made were made with that in mind. You could buy a Buchla, or you could buy a Serge, or you could buy an Arp, or you could buy a Moog, but they all lent themselves to doing pretty experimental things. Now it’s exploded to the point where if you ask someone who’s twenty years old what electronic music is, they think you’re talking about dance music. Nobody’s first idea, when confronted with the term electronic music, is experimental music, at least not with younger people. Now instead of four companies that make synthesizers, there are dozens.

Do you have the sense that the equipment that’s available to you is less open?

That’s exactly it. A corollary of this explosion is that the companies that make these things are under all this market pressure to manufacture for this market, which is a market of people that are interested in doing a pretty narrow range of activities with these boxes. Of course, you could make interesting boxes, but since the potential profit if you make something popular is much bigger than it was before, everybody wants to go for that.

We can blame the DX7 for ruining the world, in that sense.

No, I wouldn’t do that… It’s an ironic development that now we have machines that are much more powerful, and much faster, and much more sophisticated, but the things that people build them to do are much simpler than what people were building them to do in the late 1970s.

So I couldn’t find anything. I had been resisting getting into computer programming for all these years – I had no interest. People from the computer music world… I think for a long time they didn’t take my work seriously because I was playing instruments that I’d bought at the rock and roll store. Their idea was that, you know, if you were a serious computer musician, then you’d be writing your own code. My response to that was always to listen to the work that they made. If there’s something magical about writing your own code, then I don’t hear it. I was really convinced that engineering and music-making were pretty unrelated activities, and certainly that software programming and music making were really completely unrelated activities. In fact, the fact that many people tended to confuse them was one of the sources of a lot of the really bad music that was coming out of that part of the music world.

The kind of formalism that says here’s an algorithm, and here’s what it sounds like for forty-five minutes.

Yeah! They get interested in the code, and then they think because the code is interesting, the music is interesting… but those two things almost never go together.

You’re not a big systems art guy, then, are you?

[laughs] No. So my idea was always to position myself next to the engineer. So in the late 70s, when I was playing a Serge synthesizer, I got to know Serge Tcherepnin, and we’d talk about his modules. Then when I started using the Ensoniq I got to know the engineers of Ensoniq. We had a lot of interchange back and forth. So that was always my idea: that the right place for me as a composer was next to the engineer, in a real give and take with the engineer, but not being the engineer. But, when I couldn’t find a new instrument to buy that interested me… I had become friendly with David Wessel over at CNMAT, and he was really encouraging me to jump into Max… so I did it.

I think David probably recognized what you really wanted.

Well, David’s a real champion of technology.

But a champion as it sort of as an engine of idiosyncrasy. I don’t see that technophilia in him at all.

No. It’s funny, I was just thinking that normally if I were calling someone a champion of technology I would be insulting him… but with David, not at all. So he was very helpful… and off I went. I’m still not 100% convinced it was a great idea. For one thing, I’m not sure I enjoy computer programming.

Do you think it’s changed the pieces that you make?

Yeah. I definitely have a more flexible instrument than I could have purchased off the market. It definitely reflects the idiosyncrasies of my music and how I want to work it. All that’s true.

But you’re building harpsichords.

Well, the thing is… I’m a very compulsive obsessive guy. I’m an utter workaholic, and once I start a project I can’t put it down. I’m not sure computer programming is a healthy activity for me to get involved in. I’m not sure I like the person that I’ve become when I get completely immersed in Max programming.

You need somebody who really loves you to say “Bob, stop, put it down!”

Composing music, for example, is in a way better suited to my disposition, because there’s a limit to how many hours you can sit and compose. Your ear gets tired, and you notice. It’s not always obvious what the next thing is to do. It’s obvious that you need to put it down and go swimming, or go see a friend, or see a movie, and come back to it in a day or two. With programming, I feel like there’s never a logical ending point. The next thing to do is always staring you right in the face.

You always have the question of efficiency or elegance looking at you too.

Also, once you build a piece of software up to a certain degree of complexity, in order to work at it at all, you have to sit down, and it will take you a few hours to really be back up to speed to where you were, and where all the different pieces are. You know that if you stop, and then you start again, it will take you a while to get fully acclimated to where you were again.

Wouldn’t that be the case if you were building a better oboe?

No, I think it’s something very particular to programming. I’m not sure I like it.

Do you like what it does?

Yeah. I find that I’m acquiring this huge body of arcane knowledge that is useless for anything but its immediate purpose. For instance, when I was in El Salvador, the things that I would learn during the course of my day to day work, I thought were applicable to all kinds of things, and I could turn around and apply them in other fields, or in other parts of my life. But, you know, the kind of information that you have to amass in your brain in order to troubleshoot the Apple OS is not knowledge that’s going to lead to any other knowledge.

… or perhaps the community of people with whom you share it is different, or is distributed in different ways.

Uh… I don’t know. I was thinking about this the other day. I was talking with a friend, and he pointed out that that’s true with any type of engineering skill. The knowledge that you acquire to work on cars isn’t really applicable to anything but working on cars. Which is probably true… which is maybe why I’m not so happy being an engineer. On the other hand, I seem to have an aptitude for it. On that level I enjoy it, I feel like I do it well, and I love making things. I love making CDs, and I love making compositions, and I like it when I have a program that works, and there it is, and it can run…

The Biggest Prize

You described working with the Ensoniq for a long period of time and developing some facility to it. Part of the facility you develop is based on the fact that the person who made the instrument made some decisions for you. When you program you get to make those decisions yourself. Do you find that you’re sort of tweaking the instrument that you’ve made, or are you making instruments to suit a task?

What I’ve done is I’ve made a general purpose instrument. That’s basically the one and only thing I’ve done with Max and MSP and it’s taken me two years, and I’ve pretty much got it. I have, you know, a general purpose instrument that I can make compositions on, or I can do improvised concerts on, or I can do whatever on, and it’s got a video component and an audio component and… that’s what I’ve done.

But that’s fantastic. You’ve got a piano!

Well, it’s not quite a piano, but it’s something. It’s more sophisticated than the Ensoniq was. It’s more sophisticated than any of the samplers I’ve seen on the market… at least in the ways that interest me. In some ways I’m sure it’s more primitive, but in the ways that interest me it’s more sophisticated. But there’s always the thing that you can always be adding a new feature, or making something a little more elegant, instead of spending time playing the thing. With the Ensoniq that was never an option. If I was working on it, I was playing it. That’s a problem. It’s a problem because fundamentally I think composing and making music is about learning to work within limits. Basically I think all compositional techniques come down to setting yourself certain limits and then struggling against them. Whether you’re writing a fugue, and you’re going to follow the rules of a fugue, or you’ve decided you’re just going to use a twelve tone scale, or you’re going to write in D major, or you’re going to make a whole piece where you use no sounds except the sounds that you recorded at a riot, or whatever… it’s all about setting limits, and then struggling against them. I think when you’re writing your own computer code it’s very easy to forget that. Computers offer this vision that what they’re about is not limits, but about endless possibility. I think that’s a trap. I think that’s why a lot of people who write their own code never manage to finish any compositions… and when they finish them, they’re not very interesting. So, that’s a problem, a problem I have to develop my own personal discipline around. When to say the thing is done, and now I’m going to learn to play it.

Would I be correct in assuming that I’ll know if you’ve done it successfully if your performing output goes way up?

Yeah. I think this is a problem with all of this technology in general. I particularly see it with younger folks in their 20s who are getting into electronic music. They’re deluged with this market stuff. Particularly now that I’ve gotten into multimedia stuff, and I’ve played at a few of these multimedia festivals… boy, when you get into that it’s really easy to forget that making art is about working within limits. You see these kids who get obsessed with the idea that making multimedia art is about more. It’s always about more: more technology, more capability, more voices, more video processing, more this and that. They’re surrounded by all these boxes! I think it’s hard for them to see…

If the only way that you think about the tools you’re given is a collection of decisions that have been made for you by someone else, then the way that you expand your vision is not to take or create a new tool, but rather to acquire a new piece of gear. The traditional marketing hype that surrounds that is about crafting this message that says if you buy X, this is the collection of decisions I’ve made for you, but it will allow you to express your personal vision. At the heart of that is something really pernicious. I guess I can see why it must be so attractive… compared to finding yourself as you did in a way, in the wilderness, creating an instrument with a blank slate. What would your perfect instrument look like? That’s a frightening question.

Yeah. I’m really happy that I didn’t sit down at a Macintosh screen with Max booted on it until I’d played the same sampler for ten years. I’d spent ten years thinking about the features I really wanted that I didn’t have.

If you’d been faced with those tools when you were in high school, would you have ever finished a piece?

I really wonder about that. I really wonder if you haven’t spent a lot of time working within constraints that somebody else defines for you, how do you decide what you want? I don’t know.

Yeah, especially when you’re surrounded by a culture that’s trying to convince you that what you want and what you need are the same thing.

So I even impose arbitrary limits. I think a lot of composing is about imposing arbitrary limits… or even limits that aren’t so arbitrary. A lot of people use so much gear on stage. I just took that Ensoniq keyboard, that was it. I just thought… how many things can I play? If I really want to be able to play it, if I really want to have a facility over it… so what I did was the keyboard got checked in checked luggage. I called the airline and asked what the biggest box you’re allowed to carry on was. I had a box made that was that size, and then my rule was if it didn’t fit in the box, I didn’t use it. I won’t say who this was, but I can remember a music festival in Italy where I shared a bill with someone who was a pretty big name in academic computer music. It was the two of us. I showed up with my keyboard, we set a level, and the sound check was done. He brought all this stuff! The sound check took two days, and at the end of the two days he couldn’t get it to work, so he did something acoustic.

That’s the recurring nightmare of every Max owner. It’s doesn’t work, it’s taken you twelve hours to do it, and you’re standing out on stage with a banjo.

Since I’ve started using Max I’ve been in several situations where my system has crashed during the concert, or the concert has started late, because the system is much more complex. That drives me completely berserk. George Lewis, for example… it doesn’t bother him! His attitude is that this is computer music, it’s experimental… this stuff crashes! That’s part of the idiom. You reboot, and you go on.

If George Lewis is doing a Voyager gig with his trombone and the system crashes, he’s still got the trombone.

I can’t do that. So that’s been really stressful for me. I cannot explain how stressful that’s been.

Do you see a way out of it?

Well, to make an instrument that works and not mess around with it. That’s one. I’m pretty much there, actually. I just did a tour of France with Otomo Yoshihide. That was the first tour where I had my joystick, and I had my laptop, and I felt like I was back to where I was with the Ensoniq. I walk in, my sound check takes five minutes, I boot it up, I set a level, it works… I was really happy, because actually it works better than the Ensoniq worked, and it weighs about one tenth…

…and it’s idosyncratic.

One of the things that makes me most happy about it is I can go on tour and not even check any bags. I can’t tell you how happy I am when I get off the plane and walk past the baggage carousel. There’s this inner peace. It’s the best thing about the whole experience. The biggest prize for going to Max is that I don’t have to carry around that keyboard any more.

An Interview With Luke DuBois

Luke DuBois is a teacher at Columbia University in New York City, and a member of the famous Freight Elevator Quartet, whose “Fix It In Post” CD is making waves as the first release on the C74 record label. In this conversation with Gregory Taylor, Luke shares stories of synthesizer part scrounging, the early days of the Freight Elevator Quartet, and some of his most inspiring students’ projects.

Early Experience and Freight Elevators

History. How’d you get here?

I did my undergraduate degree at Columbia. My first-year here I dated a woman who was a senior and was taking an electronic music class up at the Columbia Electronic Music Center, as it was still called then. It was taught by a composer named Art Kreiger, and it was a very old-school class. I sat in on the classes with her, and our midterm assignment was to realize a two-part Bach invention using just a test oscillator and tape. So you would have to cut the tape up and splice it all together and realize that, okay, one inch is a quarter note. That sort of thing.

My sophomore year I took a class called MIDI Music Production Techniques as a follow-up. I really hit it off with the instructor, who was a guy named Thanassis Rikakis, who had just finished his doctorate. It was my first exposure to using computers to make music, and I thought it was very interesting. The Columbia studios were still all analog except for this one, so I got in on the ground floor of the gradual transformation of Columbia’s Electronic Music Center into the Computer Music Center it is today.

Good heavens, what year was this?

1994.

If you subtracted thirty years from that I would have been less surprised!

Yeah, sure! My first real fetishizing experience was when I discovered all the analog modular synthesizers down here. I thought they were really great; we had a ton of Buchla modules and a couple of Serge modular synths that I became pretty good at playing and improvising on. All the computer music work up here until my second year in graduate school was on NeXT machines and Silicon Graphics computers, and we were very much a tape music shop at the time, which is a medium I still really enjoy.

You were doing more traditional software synthesis?

I was writing my own code on the SGI and making interfaces using RTcmix and X/Motif, and just sequencing things. Thanassis and I were teaching a class called Basic Electroacoustics, and in the fall of 1998 we decided to take the plunge and try to teach something about interactive music, which is a genre that had never been taught here before in any depth. We’d heard about MSP from Curtis Bahn, who was Brad Garton’s sabbatical replacement up here the year before, and I went to a festival in Japan and there were a lot of people talking about it, so Than and I figured we should teach it. We’d never touched Max before to any degree – neither of us had a clue about it – so over Christmas break that year we sat down with the MSP tutorial and gave ourselves a completely insane crash course. I sort of got hooked on it and started re-writing all my SGI apps in Max/MSP. The main folder of Max applications on my hard drive is still called, ironically, MSP Ports.

You didn’t just sort of become a musician. You were doing other kinds of music at the time.

I became interested in music in high school, which I guess is a bit on the late side for most people. I’d played in lots and lots of rock bands, but I sort of learned composition in a very piecemeal fashion. I never really studied any composition as an undergraduate; I was always winging it, and no one ever seemed to take issue with that until I became a graduate student. I still haven’t taken much of a plunge into acoustic writing, though. I’m just not particularly interested in it. I’ve just been writing electronic music the whole time. I’m in a group called The Freight Elevator Quartet, and we do what one could consider electronic improvisation, so that’s where a lot of my focus is right now.

When The Freight Elevator Quartet started you were doing mostly analog electronics, right?

That’s right. When we started I was still doing a lot of things with Buchla synthesizers, which I was restoring at the time. We had a big largesse of modules, and I built my synth out of spares that had been left around. My senior year in college we were running these parties with the visual art students up at Prentis, the building where the Computer Music Center is based… every month we would throw one, and it was called Knuckles. The ‘official’ purpose of the parties, which were funded somewhat inexplicably by the Dean of the School of the Arts, was to promote inter-disciplinary collaboration between students in different divisions of the school. We would have people from the film division working with people from the undergraduate dance department who would be working with musicians and theater people and sculptors. It was a great idea in theory except that no one took into account the fact that when you throw a party people tend to go a little crazy…

One of the things we did was bring everybody up in the freight elevator. We’d let people up in groups of thirty or so crammed into the elevator. The bar was also in the elevator, so if you wanted another drink you had to go down and up again. By the end of the night the elevator was hopping; everybody was packed into it. Mark McNamara, FEQ’s video artist and my main solo collaborator, was the graduate student theoretically in charge of the parties. Mark asked me and my friend Stephen Krieger, with whom I’d been doing music for years, to put together a group to play in the elevator because he thought there should be some incidental music in there. So we got on the top of the freight elevator, tapped the flourescent light to get a plug running off of it and set up a PA in there.

Stephen and I got together with a friend of ours named Paul Feuer with whom I’d played before – he was a digeridoo player and played drums – and Rachael Finn, who came to the parties and played the cello. It turned out to be a lot of fun, so we started doing it at every party. Then Mark got us these gallery gigs downtown and it became a regular thing. The nice thing which we started doing from day one was audio tape everything. We had a portable DAT at every show and so we had dozens of hours of rehearsals and performances… so come the summertime we decided to cut an album out of all the live material, and that’s what we did. I did everything on the analog synth, and our sets were all improvised; we never really wrote any songs or anything.

Over the following year we wrote and recorded a studio album of tracks which we called the ‘Jungle Album’; it was a very self-conscious attempt to work in a specific genre to see what popped out. Paul and I did a lot of SGI programming to do the DSP on that album. When we were finished one of the people to get a copy was Paul D. Miller, DJ Spooky, who liked it enough to want to work with us.

Idiosyncratic Interactivity

So after you were done learning enough about Max to teach it to your students what’d you start… I mean, the difference between you and the computer music students presumably is that your background working with stuff like The Freight Elevator Quartet predisposes you toward interactivity already, right?

That’s certainly true. The first thing I did, which is not necessarily a totally unique idea, was that I was sick and tired of carrying around a Serge modular in a road case, so I just wrote myself a Serge in Max/MSP. What I wanted to do was sort of replicate the experience of just closing your eyes and twiddling all the knobs on your synthesizer, so I wrote these sequence generating algorithms in Max the just generate little synth sequences, and this all syncs to MIDI clock coming off Stephen’s MPC sampler. They’re performable sequencers, which is nice. I play with a Wacom tablet live, because the mouse is a drag, and I tap pressure and tilt and map it to waveshaper parameters. The idea is for the patch to generate little sixteen-note patterns that you can edit live – they’re all tables of different things: pitches, filter Q’s, etc.

Most of the sequences are generated according to rules I came up with based on some music theory research I did for Fred Lerdahl’s music cognition seminar at Columbia. So the riffs aren’t random, but sometimes they don’t work quite right because my algorithms aren’t entirely bulletproof. So on stage sometimes it’s a bit dicey because I might accidentally spit out a bum riff and have to fix it quickly.

So you use them for live performance?

Sure do. I started to use a Wacom tablet because the trackpad craps out in sweaty clubs. Now I use Richard’s wacom object to get at all the nifty pressure and tilt data; it’s not mapped to anything incredibly exciting, so people think I’m doing something more intense than I really am. I got this totally stoned woman come up to me after a show we played at the Cooler a couple of years ago, and she asked me if I was sketching everyone in the audience. So I lied and told her I was. It’s actually really funny the way it used to work after gigs when we played with the analog gear, because I’d get all the tech-heads who say things like ‘so which model of Clarity control voltage unit is that?’ That’s actually the other reason that I moved to the laptop, so that I could avoid having to get into an electrical engineering discussion after a gig. Fortunately, not that many people are going to be able to look at my Max patches and understand them.

[luke and gregory play with the computer]

I’m not sure whether what I’m looking at is a set of idiosyncratic tools that are really goal oriented, or something that you’ve made that pleases you that you’ve put to some other purpose.

Everything I write is really idiosyncratic. I do that on purpose. I never pretend that I’m making a generic, user-configurable synthesizer. I’ve actually talked about that a fair bit with Elliot Sharp, when I do MSP programming for him. We were talking about the kind of thing we were going to make, and I was like, I write things that are not for everybody. I can make it with lots of bells and whistles so that you can load in your own banks and whatever, but if you want just a sampler you should buy Unity. It’s a better program for that sort of thing; it will work better. The great thing about him is that he’s very receptive to the idea of programming as composition. The point is that the technical underpinnings of some of this work are sophisticated enough that really they could stand as composition in their own right. This would be no different than me writing a string quartet using these weird algorithmic rules for spitting out the melodies. I didn’t bother writing out a string quartet; I’ve got something that does it for me.

What’s been your impression of looking at the way that traditionally trained composition people go into interactive music? Do you think they find it a salutary experience?

I think a lot of it depends more on first impressions more than anything else. I think people who stumble upon this thing are very much influenced by the first one or two people they meet that do it. My first head-on run in with interactive music was with Mari Kimura. She’s very virtuostic with using the machine as an extension of her violin, and it comes very naturally to her.

Natural in the sense that the interface between her and the technology looks kind of effortless?

Yes, it’s very transparent. There’s no handicap apparent in the way she uses the computer on stage, which is very cool to watch. The best interactive performers are those who can deal with the patch responding in unexpected ways, and just keep going with it. That’s why natural improvisers make the best interactive musicians, in my opinion.

I’m a big advocate of simplicity. I never use score following based around specific pitch-based performance tracking; I think you’re asking for trouble, expecially if you’re like me and play in loud clubs and the nicest mic you’ll ever drag onstage is an SM-57. I think trusting the computer to pay attention to an unpredictable data stream is a bad idea. I try to make it as transparent as possible for the user to interact with the computer, but also I don’t want the computer making decisions that the user isn’t completely informed about. When I have the robot turned on in my patches, all the lights that the user would normally be switching switch, and all the dials they would be turning turn, so you can see what’s going on. The automatic processes aren’t working on some hidden data file that you can’t see.

My patches for Elliott always have some huge ass number boxes hooked up to the pitch trackers, so he knows if something funny is going on and he can run with it. If I’d made it a black box experience and something started going wrong we’d be in deep shit. While I really admire Max/FTS programmers who can sift through all the subpatches from the NeXT in the back of the room and see what’s going on, it’s just too complicated for the average performer to deal with. I think there’s some truth to the saying that people can only pay attention to so much at once, that people have a limited bandwidth, especially in stressful situations like performance. The last thing anybody wants to happen at a gig is to have something schiz out on them and not know about it. That’s why clarity of interface is so incredibly important.

You were talking about the idea that your experience is mediated through the first people that you meet using the tools. Tell me about your experience working with other musicians, doing patch work for other people. How does that work for them?

Elliott and Toni Dove, a New York-based installation artist, are the two main people I do commission work for. I tend to slip into an educator role pretty quickly when I work for people, so they have at least a good grasp of what’s going on inside the system. Some people who do commission work don’t necessarily feel this responsibility to make sure that the person they’re working for understands what’s going on, but I feel differently. I always comment my commission patches, so the people I write them for can fix things if they want to. Anyone can program this shit as well as I can if they want to. It’s not hard.

I actually really enjoy Max programming for other people, and I like coding Max externals in C for people to play with. Dan Trueman and I are very proud of PeRColate, not necessarily because the objects themselves are so great, but because we leave everything open source and so people can learn from it. Max is a great program in that you can get involved with it on any level, from working with interface design to coding at the lowest level in C. There really isn’t anything else out there that’s that extensible.

Teaching

What do you use when you teach students Max?

When I taught Max with Thanassis we’d create a big library of tutorial patches which we’d use in class and leave on the machines for the students to hack with. The way we’d split it is Thanassis would teach the Max part and I would teach the MSP part. There were 13 classes in the term, and we’d do six or seven patches in class, and made these patches link to the help objects for all the new objects we covered. The patches were pretty simple. We run the gamut from simple notein/noteout things to score following and pitch tracking. The interfaces are all pretty simple because we just wanted to show everybody how to do it. When I teach Max/MSP at NYU I tend to make patches on the fly in class and then save them to the hard drive for the students to use as starting points.

Teaching Max isn’t really like teaching a conventional programming language, because the set of ‘primitives’ from which you build algorithms isn’t small; it’s more like learning a foreign language, and so once you teach the basic programming interface you can show groups of objects as a vocabulary to be learned. The tutorials for Max and MSP are great starting points, but it’s very important to get a sense of what your students find most interesting.

Do you have a sense of what your students want to do with it?

It’s a really big range. I’ve taught graduate composition students at Columbia who have very specific ideas of what they want to do in terms of human-machine interaction, and I have students at both Columbia and NYU who are more interested in Max’s capabilities in terms of automatatic music generation and signal processing. The main challenge for a teacher of Max is to expose the students to the whole range of things you can do with it; most music students come in with limited exposure to interactive music and its potential, so you have to get people to realize ‘oh wow, I didn’t know you could do that with a computer.’ That kind of thing is easily taken for granted by people who are conversant with computer music, but you have to remember that for a lot of people this stuff is still complete magic.

I think part of the goal of teaching Max is to show how it can undermine your assumptions about what machines can do musically. MIDI is an excellent example; the first major assignment I give my class at NYU is to make them use the MIDI keyboard in the room to make a relational synthesizer, where different keys trigger specific actions or parameter changes but not on a one-to-one correspondance. There are a lot of people out there who walk away from computer music thinking that all they’ll ever get out of the machine is a deaf-mute reverb processor, and it’s your job as an instructor to deflect that bias.

The best experiences I’ve had in teaching Max have been when I’ve been pleasantly surprised by people without formal musical training. A lot of our undergrads at Columbia come from the experimental new music division at WKCR. So we get these students who don’t necessarily compose but are very familiar with current experimental music. They’ll want to make the computer play like John Zorn, or they’ll want to do something like a Merzbow-matic, just tons of noise. This woman in my class two years ago did a really nice realization of Lucier’s ‘I am sitting in a room…’. She did a really interesting Max patch where she stuck a CD in the CD-ROM drive, took a couple of samples off of it and made these sort of ring modulated feedback things. It was really great; she just hooked it all up to the key object – there was no real interface or anything – and you would arbitrarily press keys on the keyboard just to see what it did. Actually, it’s funny – I never showed them Bomb, but it sort of ended up working like Bomb because you never knew what the fuck was going on unless you felt like reading the manual.

… and why do that?

Seriously. We had some graduate sculptors in the class once, and this guy named Karsten Krejcarek did this very cool thing. He built this very Freudian chaise loungue, and a papier maché rock, and stuck his iMac in the rock. He had one of those stress sensors, those things that you put your finger on and it puts out a whine based on your sweat or something. So he hooked that into Max and had it pitch track the sensor. He sat down on the couch with a little clip mike and had Max detect when he was speaking, and as his stress level rose the responses from the computer became more and more Freudian. So he was sitting there saying things like ‘I’m really worried about my job,’ and if the stress was high enough the computer would spit out ‘what do you think this has to do with your mother?’ It went on like that, and it was a really funny thing.

It was using something like Eliza, then.

Yeah, it was a lot like Eliza, except without any pretense of natural language recognition. He had five or six responses for each stress level. It was meant to be performance art, so it was somewhat scripted. The patch was designed so that the first five responses were going to be about his mother, and the second five responses were going to be about his love life. It was really great.

I had another student, a sculptor named Thomas Charveriat, who is a real genius. He programs those PIC microcontrollers and Basic Stamps, and so he made a whole bunch of drawing easels that put out MIDI for the class. You drew on a pice of paper with charcoal and the paper was hooked up to an RC circuit. When you darkened the charcoal line it decreased the resistance, and the chip translated that to MIDI which drove a Max patch controlling the timbre of a drone. Very cool.

Whoa.

Yeah. He was using the resistance to change a waveshaper. So it started out as a sine wave, and then it turned into this waaaaaaaa, sounding like a digeridoo. So people could just draw, and when they were done they could erase everything and it would be a sine wave again. It was really interesting.

Fixing it in Post

That day in New York, Gregory didn’t realize that there was a Cycling ’74 record label lurking in the future, let alone a Freight Elevator Quartet release. His pal Ben Nevile takes up where the conversation trailed off:

First of all, my compliments to all of you for producing such an excellent CD.

Thanks. It was a pretty exciting project. I’ve been wanting to put together a live album of our more recent material for ages – our last live record was out in 1997. It’s very exciting to have the first release on C74.

Many of the tracks are composed of segments from several different performances. Can you talk a bit about the process that you undertook to compile the album? How did you achieve such seamless integration of the different performances?

We were lucky in that pretty much every show we’ve ever done was recorded to DAT. Stephen Krieger does all the mixing live on stage with a portable mixer, so we’ve always just chained a portable DAT machine off of it and recorded our gigs. We had about fifty or so tapes of material to work with. I made a huge database of all the DATs and we picked about fifteen shows that we thought were really on, both in terms of how we played and the sound quality.

I burned CDs for everyone in the band to go through, then based on everyone’s recommendations we sat down and made rough cuts of the tracks we thought would work well on a new live album. We assembled all the tracks in Digital Performer and Stephen worked very hard to get reasonably seamless crossfades between all the different segments, so that you wouldn’t really notice where the cuts went from one performance of a song to another. We wanted to include different performances of the same song in each track, so on most of the songs on the record there are as many as five or six different performances of the song in there, all crossfaded together and occasionally overlapped.

My one regret is that we never did multi-track recording live, so we had to jettison a lot of material simply because there was something a little iffy in the mix. Had we recorded everything to DA-88 or something we could have really ‘fixed it in post’, as it were. As it stands I’m amazed we got such a good sound considering everything was mixed live to 2-track DAT; but that’s really a testament to Stephen’s ability to keep a grip on everyone’s levels while we’re all improvising live.

Parts of the album you performed with modular syntehsizers, and other parts with your own software. How did your approach to live performance change as you transitioned to Max/MSP?

The transition from the analog gear to the PowerBook was fairly sudden and went along with a few changes in the way we were working in the band. The main change that prompted a shift to the laptop was the collaboration record we did with DJ Spooky. We had a lot of raw material – beats and bass lines and strange noises – that he had given us to work with or had recorded in the studio with us. I really wanted to change my role on the record from ‘maker of strange beeping noises’ to ‘purveyor of strange signal processing techniques’. Since the modular synths could only filter or put strange rhythmic envelopes on the sound, we ran all the samples through little Max/MSP patches that did all sorts of strange things and then re-recorded the output. As a result there’s hardly anything on that album that I ‘played’; most of my contribution to that record is in the nature of programming.

The second change was that the analog gear wasn’t lending anything in the way of precision to the band when we played live, and we were starting to perform ‘songs’ live, so we needed some consistency. The Buchla was especially troublesome, but the Serge was pretty flaky too, both in terms of getting consistent midi sync and in tuning: whenever someone turned on a light switch in the bathroom at some of the clubs we were playing at my tuning would drop up to an octave. We got a commission sometime in 1998 for a new piece to play at the Kitchen as part of Columbia’s Interactive Arts Festival, and I wrote all my parts on laptop instead of using the synth, and I just realized it was so much easier and more reliable. I only use the analog gear now in the studio or on special occasions like release parties. I miss it sometimes, but the headaches of carrying around two flight cases of synth modules and sync equipment and having to set it all up I don’t miss.

The talk you had with Gregory gave me the impression that your patches were modeled after the way you interacted with the modular. Has that changed?

My Max programming was originally very much based around making a ‘virtual’ Buchla. I used to call the project the Virtchla synth… the idea was to design an interface that roughly simulated the sheer randomness of tweaking lots of knobs and re-patching things onstage. There are lots of weighted randomness algorithms and gates and switches in my patches, as well as a robot which periodically goes around and changes things every four measures or so in case things are getting boring. Gradually I moved into using samples and strange effects live, and I also have patches that take live instrument input to either trigger events or add some strange effect to the sound. The signature sound of my laptop is still a waveshaped sine wave with a variable-Q filter, which is the closest I can get to the rich distorted oscillator sound I used to have.

Basically you can’t beat the tactile experience of working with modular synth equipment, and I never even tried to imitate it. I hardly ever use a fader/knob box for that kind of thing. The one piece of gear I do use for interface work which I find indispensable is the Wacom tablet, because it’s impossible to use with precision in the same way that you can never turn a knob on a modular synth to exactly the same spot as before… you’re always doing something a little different with the pen, which adds a much needed dimension of expressiveness into the sounds coming out of the computer.

What about the other members of the band – have they changed the way they play in response to any changes you’ve made?

The transition to laptop has made it slightly more common for me to play lead melodies in the head of the song than before, since I can guarantee that it will come out in tune and in sync every time. If this will last is a little hard to say because every year or so we have an equipment explosion where everyone in the band gets a new piece of gear that they’ll use for everything for a while. Gradually we settle down to a comfortable equilibrium where nothing dominates the soundscape too much.

In “traditional” bands there are a lot of physical cues, things you can understand by watching the other people play their physical instruments. Do you miss this, or is it not really an issue?

We work, as far as I can tell, pretty much like any other regular gigging improv band on stage. The fact that we’re playing downtempo and drum and bass dance music and not jazz changes the dynamic slightly, but we still make eye contact with each other, yell at each other and do lots of hand waving. We still get most of our cues from just watching each other and listening, like any group would. I think the technology is still very much something we enjoy using to facilitate creating a unique sound experience, rather than it being the whole point of the exercise.

The fact that the digerati have over the years taken the term ‘interaction’ and turned it into a piece of technological lingo is fairly offensive to me; four people on stage with instruments is a priori a more interactive experience than four computers on stage could ever be. That we use a lot of cool gear and computers shouldn’t really take attention away from the fact that there are four people up there in charge of everything making the music.

Can you talk a little bit about how you treat live instruments with your computer?

My favorite array of MSP patches contains a lot of granular processing, some weird out of tune comb filters, and a Chebyshev waveshaper which I use to mutilate everything. Pretty much any instrument we use is fair game to go into the PowerBook, but on stage the one I process the most is my guitar. I’m a pretty lame guitarist, so I’m sure a lot of it is a subconscious effort on my part to clean up my playing and make it more interesting.

So what’s on the horizon for computer-based musicians?

It’s a bit hard to predict the future of computer music per se, but I can comment on two trends that I expect will continue into the near future. One is how computers are doing a fair bit to democratize, if you will, making music. This has a good side and a bad side. The good side is that there are more people making music, both on an amateur and professional level, and a lot of this has to do with the fact that computers bring down the expense curve of doing professional quality recording. The risk of all this is that computer software will become less and less sophisticated to try and target beginners who might not realize all the possibilities that exist; the amount of music out there that sounds like ‘compose-by-numbers’ will probably increase before it decreases.

I feel that it’s really important for music educators to teach aspiring computer musicians how to subvert the system (whatever the system may be) at a very early stage, if only to show that computers can really help you work outside the box if you want them to. All computer software that purports to facilitate the creation of art is biased, whether intentionally or not, and it’s very important to locate those biases and know how to work around them. One of the reasons I like max so much is that the bias isn’t an aesthetic one, but rather it simply promotes a specific working methodology.

The other trend that I’ve noticed as computers have become faster is that the barriers between different types of media are gradually collapsing. You’re going to see a lot more painters-turned-musicians and musicians-turned-video artists; I became pretty keenly aware of this when I was at Steim with the freight’s video artist, Mark McNamara. He taught himself Metasynth in about a day and a half and was making perfectly respectable beats in no time just by manipulating image patterns.

I think the most important thing about technology is that it can break barriers both aesthetically and synesthetically. Maybe in five years we’ll all be beta-testing MOP (Max Olfactory Processing). Then again, maybe not, but I wouldn’t put it past anyone.

An Interview With Amnon Wolman

Amnon Wolman creates music with technology and for instruments with two distinctive features: first, a subtle and complex relationship with popular culture and second, a concern for the dramatic nature of sonic evolution. His first release on the c74 record label is “Dangerous Bend.” In this conversation with Ben Nevile, Wolman discusses his romantic compositional techniques and reveals the unusual nature of his introduction to computer-based music.

History

Amnon W.Can we start with a bit of your history? Where do you get your ideas? What are your earliest musical memories?

I was born and raised in Israel. In 1968 I spent a year in Los Angeles which connected me to American popular culture in a way that was not present in my life before. I played classical instruments throughout my early years. I served in the Israeli army for three years – compulsory. Not a pleasant experience but not very traumatic either. I first acknowledged to myself that I was gay when I was 17 and to the world when I was 25. That was not a simple or easy route.

My first musical memories are of family singing. We had Friday dinners at home with the whole family and we would sing together. It was a highly physical activity. I felt the music in my body and mouth and ears more than hearing it as an outsider and an audience member. The first major classical piece that I was involved with as a youngster singing in a children’s choir was Bach St. Matthew’s Passion when I was 12. It made a huge impression on me and is probably the single moment when I realized that I needed to be a musician. It was like a drug, I felt elated.

So how did you become involved with computers?

In 1981 when I was completing my masters in composition at Tel Aviv University, the Lebanon war started in Israel. I wanted a way out, so I applied for a student exchange scholarship from the government of the Netherlands. I received the grant to do something in music that I could not do in Israel. I heard that there was a small group at the University of Utrecht – Institute for Sonology – that was working on computer music. At the time I was this strange combination of a politically minded, conceptual, somewhat minimal romantic composer… and I suspect I still am. I guess some conceptual music is highly romantic, and to be political implies some romanticism and naiveté too…

Anyway, I decided to go to Utrecht because I thought that using the computer to create music was a terrible idea, that it was cynical and mechanical. As often happened to me at that age I had very strong opinions about things I knew nothing about. I decided that I needed to know more about it in order to talk intelligently against it. But I was bitten by the bug, and the idea of creating sounds on my own has been very exciting and the highlight of my day ever since.

Tell me, was there something specific that caused you to change your mind?

Yes, it was working with sounds that changed my mind. I love imagination, and when working on a score for instruments imagining what it would sound like was a wonderful fantasy. But now, since 1982, I can put my hands in the dirt. I can design the exact sounds I want, and just listen to them evolve – not pitch, not rhythm.

After Utrecht I applied for graduate studies at Stanford where I was off and on until the end of 1989. From 1990 I’ve been teaching at Northwestern University, and from 1994 I also hold a position at Tel Aviv University.

How does your time at the two schools compare?

I feel safer as a teacher in Israel. I never question my language and my cultural references. My English is good, yet still I am not sure which words I may use with which person. When is it appropriate to use a slang word and which one, and what does it say about you when you use it? The same is true for cultural references. I know what it says about me if I say that I like the Beatles, that is safe, but when I say that I like Madonna, Tom Waits and Xenakis I know what it would mean for my students, and maybe my colleagues, but my other friends? People I meet in political activism groups? In Israel I feel that I know exactly what they mean, even though I may be wrong. I have less definition as a person here. For a long while it made my life easier because I could define myself, but now I miss being clear.

Dangerous Bend

I really like the music on your C74 CD. I find it incredibly soothing.

I can’t decide if I like the description “soothing!”

Well, it’s soothing to me. Most of the music I listen to is jagged… it’s nice to hear something smooth. Is that not how you think of your music?

Interesting. It is not how I think of my music, mostly because of my politics. I guess for too long I’ve stood on barricades saying that music is an art and as such it presents many things, not just beauty and relaxation. But then I go and create music that is soothing… it feels weird in the context of my self-perception. But there is not a whole lot one can do about this. There is always a distance – huge I suspect – between the ideology and the art one creates. In the end I sit at the computer and listen to what I create and decide if it is what I want to create and ideology is never in the room during those times.

Is there anything that you’ve composed that comes more from an ideological standpoint, or has your creative process always been quite separate?

I think that the creative process is always an amalgamation of everything, the intellectual and the emotional. But I guess what I am talking about is the rigors of taste. That is, if I have an ideological or conceptual vision for a piece, by the time I work on it the final choices are about “what does this sound like” and “I like this” or “this is too much” or “this is too beautiful, what will the neighbors say.” I don’t have many voices of this last kind, the “what will my colleagues and friends say,” but every once in a while I realize and chuckle when I finish a section and think to myself how so-and-so would like this…

But to make a long answer even longer, I think the final cut is irrational, and I’ve never finished a piece where I thought, “oh it does exactly what I decided in advance – so it’s okay, even though it does not sound so great.” I’ve always gone and fixed it, started all over, or scrapped it. I hate to admit my romantic streak, but the final decision is always left to my senses.

What compositional techniques did you use on this CD, both inside and outside of Max?

Mostly I used processed sounds. I have worked in the past with synthesis, but the last several years have been almost entirely based on processed recordings. I make recordings everywhere, with people and in nature, and then I process them in different ways. From filtering to different versions of granular synthesis using the recordings as the basis for the brain. I use a lot of time distortion, and different algorithms of phase vocoding.

I think that the idea of processing a recording of, say, a family conversation is very powerful. Somehow I feel that the essence of the sound stays. Even if I am the only one who knows where the sounds came from, some of the magic of the personality and the situation are folded into the sounds. Obviously the actual physical properties are inherent to the sound too. I think perhaps the most personal statement I can make about the pieces you called “soothing” is that I don’t hear them as such because I listen to the sounds. A slight change, a disappearance of a harmonic, or an emphasis on a group of harmonics makes huge dramas in my listening experience and does not sooth me… but I know I hear sounds differently than other people.

Can’t Face the Music

Sure – you’ve made the sounds, so you understand them in a deeper way than anyone else, and your listening is therefore completely different. What has had the most direct effect on the romantic inclinations of your musical direction?

The most important musical influences were my teacher in Israel Abel Ehrlich, and John Cage- I met him in Stanford in 1985 and we remained friends until his death. Other influences have been friends and colleagues, usually young composers who were compatriots as students or faculty members and then a few of my own students. There are a few prominent names: Chaya Czernowin, Osnat Arbel, Yuval Shaked, Bill Schottstaedt, Joanathan Berger, Richard Karpen, Michael Pisaro, Jay Alan Yim, Kunsu Shim, Gerhard Staebler, Jeff Kowalkowski and Jenny Walshe. Most are not computer music people, and represent either an influence on my conceptual/intellectual side or the romantic side.

Listening to the greats, some of whom I had the luck to study with, has also obviously refined my process but listing them seems a little more removed from my day to day activity. With everyone on that list I can recall numerous conversations that altered some part of my thinking and helped me refine my own sense of music. I have no doubt that my personal relationships changed my sound world drastically. Most importantly there’s my partner Eyal Levinson who helped me get back into listening after several years of trying to avoid music…

In the last little while several composers have told me they don’t enjoy listening to music any more. What pushed you away?

For many years it was hard to listen to music “for fun” for me. It was too much work. I enjoyed silence. I still would rather get home to a quiet house. I know for a fact that it is hard for me to work on creating music while listening to music. If I wake up in the morning and listen to the radio it’s hard for me to get into composing. This is why I’ve become a morning person, and compose before anything else. Also I think I became a musician because I like being active at this game, the playing of music. Listening to music is a passive activity, you don’t get to do anything, and it’s a different activity, a luxury. I know many musicians who are bored in concerts unless they are on stage.

Yes. So how does that relate to something like “the communal techno machine,” where there was mass participation… or was that something completely different?

Hmm… that started because I wanted to create a piece based on the Andy Warhol Diaries. These were not really “diaries” as such. He would call “the factory” every day and tell the person who was keeping the diaries, Patricia Hackett, what he did the day before and how much it cost. This was done because he was audited yearly by the IRS. But little details crept in. For example, and I am paraphrasing off the top of my head, “I had lunch with Jacqueline Onassis, she had a great hat, $10…” etc. It describes an important period of US history between 1975-1985, for me, and it describes it as a pointillistic picture full of insignificant or important details without a hierarchy. This period is when the liberal community’s only ideology was “live and let live” and the right wing community developed a very clear ideology and agenda. It is also the period of the last big gay parties and the beginning of AIDS.

I decided to use the texts and realized it would have to be a really long piece – 11 hours. At the time Canton Becker was a student of mine, and he was a rave fanatic. I knew nothing about it and he introduced me to techno music and the rave scene. I suggested to him that in order to create music for the piece he should build the communal groove machine, which would, with the help of others on the internet, allow us to create the music needed for the piece. He built it under my direction. Indeed at the last moment I discovered that we forgot to add a transposing element to it, so most of the piece is in C…

Ha, that’s funny. How long did you say the piece lasted?

The piece was eleven hours.

How were the people on the internet able to affect the music? In what form was their input?

The techno machine had a library of rhythm sections, bass lines, chord progressions, and feels – tempo accents, etc. People would respond to questions by choosing or entering new bass lines, or new rhythms and then it would create the song that they imagined but could not hear. The resulting information was interpreted through a MAX patch written with Matt Moeller that allowed us to mix the songs. The final production of the songs was done with the help of other students, most prominently Andy Knight. The piece also involved three actors/singers for which I wrote parts and a series of videos created by H.D. Motyl.

It was a fantastic experience. The communal groove machine was interesting in many ways, but most profoundly, for me, because it gave me a glimpse on how many people compose and have a clear idea of what their music should sound like, even though they are not musicians. You must remember this is the internet before browsers, only text was moving around. As part of the machine we asked people to include a description of the songs as they thought they should come out, hoping to use it as an indication for the mixing and production. People were very forthcoming, very clear and precise. I was very excited: composition was no longer an artistic activity for specialists, it was open for anyone who had ideas.

You mentioned The Beatles, Madonna, Tom Waits… how has your relationship with popular culture affected your artistic output?

I have a relationship with popular culture. It is part of who I am, part of my thinking and musical world. How it falls into my work is hard to explain. The Andy Warhol Diaries is a clear example where an element of popular culture was the impetus for the piece. In other pieces it may be a sound, or a formal musical element using only four chords…

It’s hard to explain. I don’t write popular music, that is, I have not in 20 years. But I do listen, when I listen, and it’s a part of my sound world. My friend the composer Michael Pisaro once suggested to me that in order to incorporate pop music successfully into classical music you have to let go of your respect and love for it. To my mind, most composers my age find that hard to do. So the pieces seem to be orchestrations of pop music with a large orchestra, or with computer music. It seems that I may have decided that perhaps I too can not do it, so I just don’t try. I don’t try to create popular music with my music, but I use ideas from popular music as metaphors for some of the pieces I create.

Learn more about Dangerous Bend, the Amnon Wolman CD on the C74 label, by clicking here. You can visit Amnon’s personal web page by clicking here.

An Interview With Kim Cascone

Kim Cascone has worked as a synth tech, edited music for David Lynch films, founded San Francisco’s first ambient electronic music label, and helped design new systems of audio for video games.

In this conversation with Ben Nevile, Cascone discusses his electronic history, his interest in genetic algorithms, and a fresh compositional direction that he calls “New Density”.

Movin’ to California

Cascone Glitch PictureWhere’d you get started with all this stuff?

I went to Berklee College of Musicin Boston. I studied music there, electronic music mostly.

When was that?

’73 to ’76.

So that would have been modulars…

Yeah, all basically patchable analog synths back then, but also the beginnings of computer music. There were languages around at MIT.

Did you have any exposure to it in Boston?

Not at that time, no. When I left Berklee I came back to New York to study privately. It was at that point that I discovered I had a talent for electronics, so I went to technical school. I had been working for a company called Electronics for Medicine. They made heart rate monitors and sleep activity monitors. I was a tech, and they sent me to school to study electronics, and so I got some training in the technical side of things, math and physics and what not. At that point I started getting interested in microprocessors, and through my interest in microprocessors, the Z80 and the 6502, I sort of bumped my head up against the whole computer music thing. And I discovered CMJ

Were you making music this whole time?

Yep. I’d built a synth out of kits made by a company called Aries. They were based in Massachusetts, and they made a modular system that was very much like the Arp 2600. One of the design engineers from Arp actually went over to Aries…

I imagine those were pretty small companies.

They were very small, sort of grass roots… kind of similar to today’s software and dot com companies. There were a lot of people trying to do interesting things with electronic music.

So when did you move to California?

I moved to California in ’83.

What precipitated the move?

Various things, one of which was that in New York it was very difficult to break in on any sort of artistic level. Lots of little downtown mafias, art mafias, and it was very difficult to play anywhere, it was very locked in. So I visited San Francisco and discovered a sort of free spirited anything goes kind of attitude that I really liked. There was a lot of experimentation. The Bay Area has a history of that experimentation in various ways, you know, lifestyles, or psychedelics or what have you. That appeals to me, the spirit of experimentation.

That was 1983, and your record label, Silent, started a couple of years after that?

I started Silent in 1986. Although it was easy to get gigs, it wasn’t easy to get record releases. I had been releasing some work on a little label from Massachusetts called RRR. They released my first two LPs as PGR, then I had a French company release my third one. I just decided at that point that I wanted the means of production in my own hands, so I started my own record label. But I didn’t want to necessarily have it be all about me, so I started releasing work by other people.

I remember reading the story behind PGR somewhere, but I forget now… what was it, something something research?

I hate what it turned into, because everybody seems to know it as Poison Gas Research, and it wasn’t like I really wanted it to be known like that, because at that time there were a lot of industrial bands trying to be really dark. It was more of a joke than anything, because the Oakland rehearsal space we were working in was in a very bad area. This friend of mine Tom had been living there. A lot of guys from the neighbourhood came over and asked him what he was doing there. He didn’t want to be bothered so he just said “government work”. So they said “what kind of government work?” and he said “poison gas research.” So from that point on nobody bothered him. They left him alone, and that was kind of like our cloak of invisibility. We were able to practice there and nobody ever hassled us coming and going. You know, we were lugging strange cases of stuff…

The poison gas, naturally!

Exactly.

So what was it that caused you to give up Silent?

A multitude of things. One thing was the way that indie labels had evolved at the time. You had to release a certain amount of work in order to sustain the operation. When techno started becoming popular we became the electronic music label in San Francisco. This is like, 1991. Raves had been going on for some time, but they were becoming more popular, and more people were making this kind of music. So we started getting deluged with tapes. People were coming by and were interested in what we were doing. We just sort of got pulled along. People that were working for the company were very involved in the scene as well. It started evolving into an area that was very different than what we had started out doing. There was some correlation there… a lot of the guys that had been doing industrial work or experimental work were trying to do techno, and there was a lot of cross over and experimentation. So we started releasing a lot of product.

At one point we switched to a different distributor who promised us a lot of exposure and a wide net of distribution. What ended up happening was that the company we signed with got bought by a bigger company, and then they bought a smaller company. So all of a sudden our account, unbeknownst to us, had been switched to this smaller distributor they bought and we had no idea. They had discussed with us the whole strategy: we would press up this amount of records, we would have all these chains covered, we had to send out all these promos… We adhered to all of this, and then discovered at Christmas time that they had not been distributing our stuff. Our stuff had not made it to Tower or Borders, or any of the chains. They basically dorked us. Not necessarily on purpose…

But you just got lost in the shuffle.

Exactly. So we had, like, $30,000 worth of returns. It was a big hit, we were not doing very well. So I was going to actually bankrupt the company, take it down, but an employee stepped up to the plate and said I think I can make a go of it, why don’t you sell it to me? So that’s what happened. Also at that time my wife and I were getting very interested in working in the internet…

…the whole explosion was about then I guess.

Yeah, it was everywhere.

Genetic Games

Since you’ve got the computer open, why don’t we talk about your performance Max patch? You were using the patch from your Residualism CD [on Mille Plateux/Ritornell] last night, were you not?

The original studies for Dust Theories were done with the patch from the Residualism CD on Mille Plateux/Ritornell and yielded a couple of pieces that I liked but it was still not what I wanted to interact with while performing. Before my trip to Europe in the late summer I took my Residualism patch and revamped it completely. I replaced the sfplay~ objects with the groove~ objects so I could control the playback rate of each sample and added a lot of plumbing in order to have better control over the vst~ object. I was also working on a new patch that was going to make use of genetic algorithms. The objects that I had gotten ahold of were kind of difficult to work with. There wasn’t a lot of documentation, so I had to ask around on the max list, and I got some help but it wasn’t really yielding results that were all that interesting. I think it’s going to take a little more work in terms of playing around with it.

How were you trying to incorporate the genetic algorithms?

I’m really interested in behaviours. I’m not all that interested in DSP. What I am interested in is imparting behaviour to the playing back of wave files. We did something similar at Staccato called the event modelling. We essentially modeled a lot of natural type behaviours like explosions, car crashes, ambiences, through either random generation of waveforms or a stochastic envelope of density.

Stochastic envelopes of density… a granular thing?

It is sort of like a granular thing except we used very small sound files instead of grains. You can think of them as grains…

…but they’re really individual sound files that get randomly played back and spread across a space?

That’s right, but with a certain distribution, because the way that car crashes and broken glass and all that tend to happen is with a very dense beginning and then it sort of trails off.

Oh, I see, like this? [Ben traces an exponential decay with his hand]

Exactly. So they have the ability to create an envelope of density with the random playing back of wave files. The sound files are randomly chosen every time. So there’s a pool of files and every time you trigger the events to happen, different wave files will be called, so you’ll get different car crashes every time.

Has that type of work fueled your interest in the mathematics of chaos?

Well, kind of hand in hand where I had the interest and it sort of coincided with some research that was going on at Staccato. My interest was part of what got me hired there. Although those guys are, you know, serious PhD types, I have enough of an intuitive grasp that I can contribute…

…and you have the sound design skills.

Exactly. And I have a bit of the Music N background too, Csound… so although I’m self taught, it wasn’t that difficult for me to grasp a lot of the concepts because I had been dealing with them before.

When did you start using Max?

I started using Max shortly after getting very frustrated with Csound, after bluecube() came out. I worked at Headspace with Chris Muir, the guy who wrote the Uzi external. He was a big Maxxer, so he was constantly using it on the job, and he was showing me stuff, and telling me how great it was, so I just finally got it. I started using it and became obsessed with it, pretty much. That’s kind of what got me the job at Staccato.

Max?

Max and Csound, being able to work in both. The tool that I used at Staccato was very much like Max.

Oh, what was it called?

Synthbuilder. It has the same patchable paradigm, so I was very familiar with it.

Does it have the same level of control?

Yeah, it’s pretty granular. It doesn’t have the same community that adds interesting externals to it, but it can do pretty much anything in terms of sound generation that Max can do.

Did you build Synthbuilder right into games?

Yeah. The engine itself is bound into video games, and then we created algorithms that do different things: physical models of race cars, behavioural things for environments, or car crashes… that sort of thing.

I’ve always thought that would be a good thing for Max to be used for…

You wouldn’t want to get into it. The video game business is really brutal.

Really?

Yeah. Audio is always the low man on the totem pole. No matter how much lip service a company pays to having killer audio, it’s just a check mark on the box. You’ve got this situation where you’ve got the game programmer and the sound designer. They’re two completely different ways of thinking and viewing the project. The game programmer’s obviously somebody who’s coding so that it works flawlessly in the game. The sound designer is someone who’s creating all the sounds and doesn’t really care about the coding as much, but the two people need to be able to talk to one another. That’s where a lot of implementation issues come into play. The programmer doesn’t necessarily know anything about audio or how it should be implemented, so they’ve got to communicate on some common ground. Most of the problems with bad audio really come from that inefficient communication between the designer and the programmer. So, we thought we had a really good tool that enabled the sound designer to generate an algorithm that can be handed off to the game programmer. They don’t have to worry about talking the same language, because all he has to say is okay, I’ve exposed all these controls to you. You need to send values in this range with this name to these controls.

So you can give it to the programmer and he can make it work.

Exactly. It becomes an interchange format. It really has helped a lot in terms of being able to get better audio to happen in games. We still had a lot of work to do in terms of getting it smooth in terms of what the sound designer hands off to the game programmer. Not all sound designers can work in Max or Synthbuilder. They should, but they don’t have time. The way they think is Pro Tools. They want plug-ins, they want linear, they want to be able to see their sound files, mix it down… it’s the mixing board and tape deck kind of paradigm that they’re dealing with. Max or any kind of patchable architecture is not linear, and most sound designers don’t think in terms of non-linear architecture.

But some games are non-linear. They’re piecewise linear, I guess.

They’re interactive, but they’re still linear in some way. They still have some narrative. They may be branching narratives, or conditional narratives, but they’re still narratives. The sound designer doesn’t initially concern themselves all the time with that aspect of games. They are given a hit list of all the sounds. They say okay, we’ve got this character, we want you to cover the footsteps, they kind of sound like this, he’s a really heavy guy and he’s wearing big boots and he’s got armor, so he’s going to jiggle… Sound designers cover all the sounds for various objects, but how they’re controlled in terms of behaviours and stuff, that’s the game programmer.

So maybe there’s room then for somebody who would just be a sound programmer who would take what the designer does…

Yeah, that’s the missing link. A lot of game companies have audio programmers, but typically they’re people who are not sound designers, they’re kids out of school who get their first programming gig doing audio. They don’t do a much better job than the game programmer or sound designers. We were working on an EA title – Nascar 2000 – and the audio programmer was pretty sharp, but still he had to call us all the time with questions about the API. It was a lot of hand holding. They don’t have time to read the manual or the docs. They just want to be able to look at it, understand it, and go.

I guess that’s what I mean when I say it’s a brutal industry. There’s absolutely no time for anybody. It’s all deadlines and audio’s always the last thing to get implemented, and it’s two weeks to do three months of audio.

Business.

Yeah, totally.

The Behaviour of Mistakes

So what about your music, then? How has it changed since you’ve started using Max, or how has your approach changed?

Well, one good thing is that I can basically have my studio contained all within the laptop. That makes life a lot easier, having everything in one room, so to speak. Thinking in terms of behaviours – that’s opened up a whole new area that didn’t exist before.

Can you talk a little bit about that?

Sure. Similar to what I was saying before about random behaviours and being able to read behaviours or being able to impart behaviours to sound files… that’s really what I’m interested in, and with Max I can really experiment with those ideas very easily.

Does the Residualism patch have any of those behaviours?

Yeah – it’s pretty much random. I have four players, and basically they just look into a folder and fill a list with all the files that are in there and randomly throw them at me. Each player has different random files that I get dealt, and basically what I do is mix on the fly. If something isn’t working I can go in and select a different file, but typically what I do is just mute it. It’s sort of a discipline – I wanted to try and get better at mixing on the fly, and trying to make it work all the time, work with it. It’s really difficult because sometimes it’ll deal you bad cards. You get a bad hand and you don’t know what to do with it.

Where do the sounds come from?

The sound sources are all internal, all basically stuff I’ve developed using Csound and Max and various softwares. I just keep working in them. I typically prepare all my files in Vision with VST plugins, a lot of Pluggo plugins, stuff like that. I just keep generating stuff that way.

Working it over and over…

Yeah, or finding and developing new files I just keep adding to the reservoir of sounds. Everything is silicon-based, nothing comes from the outside world.

It still sounds very organic. Maybe that’s the random element.

It’s partly the sound files too. Any time you generate material you have that self-policing process where you aesthetically choose certain sounds over others. What I choose obviously has a big effect on the overall sound. I think I tend to gravitate towards either highly synthetic sounds or somewhat more fluid organic sounds. I like to mix them too so that there isn’t just one or the other. I think there have been times when I have gravitated towards more synthetic or more organic sounds, but I think I’m gaining a balance.

The sound is very lush and full… just natural, like you’ve plunked yourself down in the middle of a dark field in a foreign country where you aren’t familiar with the wildlife.

A lot of people have said that they hear insects, or birds… I guess there’s a little bit of the misty bog kind of thing, this natural synthetic habitat. That’s the other interest of mine – I’m not really into narrative, I’m really into different kinds of space. I don’t particularly like to have a point A point B, start finish – I just like to throw you into a space. I like for people to build their own narrative, whatever they want to do with that space. If they want to envision themselves in a field, or there are crickets, or birds, or what have you, I think I’m more comfortable with that than A, B, C sharp. I’m not really into loop oriented performances for non-beat oriented music, either. I find it kind of boring. I like to keep things moving.

That’s maybe the greatest thing about Max – like you said to me last night, it allows you to get your ideas into a simple form and execute them. It’s just so flexible.

Everytime I go back and develop a new patch in Max I go on a total binge. You get in a zone. First you want to make the patch work, then you start wanting it to look better, and be more efficient and beautiful…

That’s an interesting way to perform, to leave it up to the randomness and balance whatever is thrown at you.

Exactly. It’s a very Cageian thing. It’s actually harder for me to be in control of it on a very exact level. I don’t find that very fulfilling, I like to intereact with the process. The fact that I can get dealt all these random events and try to make sense of it on the fly… I think artistically it’s very satisfying because it kind of develops a certain way of thinking about the material.

Has your technique improved?

When I’m doing it a lot I get better at it. When I’ve been away from it for a while it seems like it’s rusty. When I was touring Europe last summer, the difference was amazing… doing it for a period of three weeks almost every other night… you know the material, you know how to deal with certain situations… there’s a certain fluidity that develops.

You seem to be doing a lot of things that involve random events. Did that lead to an interest in “glitch”, music made out of mistakes?

When I built my own synthesizer from Aries kits back in the late 70′s I had made some mistakes in soldering or diode orientation that resulted in some really frightening noises…but I didn’t really follow this method of working. In 1977 I heard a record titled the Sonance Project by Reese Williams which was a sound collage of vocal detritus or mistakes that really moved me. These types of vocal sounds are often edited out of dialog for films or commercials but were used here as a sound source. It served as a microscope into the little things people say or vocalize that we usually mentally throw away. From then on I became very interested in “systems”, whether they be physical or conceptual.

It wasn’t until I owned a sampler that I discovered some bugs in the OS that created wonderful sounds. If I took the sample playback pitch parameter and turned it all the way to 0.00 the sampler would start randomly playing through its entire memory. It would find parts of samples I had erased from weeks prior as well as make current samples sound very broken. This “feature” was rather intermittent so I couldn’t rely on it to happen but when it occurred I’d record some of it to DAT and then pull it back into the sampler for further work. Unfortunately I don’t think any of these experiments yielded anything very useful at the time so none of it was released.

When I started doing all of my work in the computer I found the space and impetus to start exploring the “edge-boundaries” of software a bit more. At Staccato we used alpha software that was often in a very broken state and resulted in some very interesting sounds. This beta-test technique carried over into my compositional ideas. I’m no longer as focussed on the idea of failure/mistakes as I used to be but I now contextualize it within the framework of information of how a system can be prone to failure. I’m writing an article for Mille Plateaux on this new direction. I call it “New Density”.

Oh, I’d like to hear a little bit about “New Density”. You told me in the car that you were tired of minimal music. Is this new direction a reaction to the sparseness that’s dominated the last few years?

Yes, the aesthetic problems of minimalism are well known and have proven to be a dead end. There’s no clear aesthetic solution to minimalism and artists abandoned the movement in the 70′s for that very reason. The new austerity evident in microsound or glitch music is an interesting approach to minimalism, but after a while it gets to be a little tiresome. There’s too much “me-too” product emerging, and it obscures the work of the more vital artists.

Even without the glut of knock-offs there remains the issue of what it is that minimalism is trying to say in the year 2001. The mediascape today is overloaded and extremely dense and that’s much more exciting to me than the lack of information found in minimalism. One of the problems I have with minimal electronic music is that it hinges on deep listening, which I view as a passive listening mode. I prefer to listen to sound in an active mode where the music is read like text and where multiple channels of information are presented simultaneously, forcing one to aurally multitask. This allows the listener to situate themselves in the audio information in a variety of ways, sort of like a mix of sonic cubism and futurism.

The work I’ve been doing lately is informed by information theory and informational aesthetics. There’s a simple model used in information theory that shows the channel of information being mixed with noise. You can extend this model to one of modulation where the information is the carrier signal and is modulated by another signal containing information. So in sound art this opens up many areas of investigation. One example would be current work in documentary audio like Alejandra & Aerons “La Rioja” on Lucky Kitchen or artists who use field recordings mixed with electronic sounds or manipulated via DSP. Although I used to work with field recordings quite a bit back in the mid-80s, I find more interest in constructing my environments with completely synthetic sounds. I’m fascinated with how information travels up the chain of abstractions in a computer and I’m trying to clarify that process for myself in my new work. Part of the solution so far is to keep all information synthetic and layered in a dense manner so that information can come from various sources such as the patch, the soundfiles, the interface, etc. I haven’t worked this through all the way yet as I find myself drifting on a surface of ideas that pull and push me in many directions.

Learn more about Dust Theories, the Kim Cascone CD on the C74 label, by clicking here.

An Interview With William Kleinsasser

In the last 20 years William Kleinsasser has received national and international recognition in competitions, conferences and festivals by pushing technology to its limits. The c74 CD Available Instruments showcases the composer’s ability to adapt digital technology to the orchestral environment.

In this interview with David Zicarelli, Kleinsasser discusses the fundamental challenges facing computer music, and connects the dots between yesterday’s tape music and his modern interactive compositions for computers and traditional acoustic performers.

(more…)

An Interview with Barney Haynes

Barney Haynes has been working in the fields of reactive installation and invasive media for 10 years. As a Professor at the California College of Arts and Crafts in the Film/Video/Performance department, Barney is helping to define the parameters of artwork at the intersection of computing, physicality, mechanical behavior and appropriating dot_com detritus. In this conversation with Ben Nevile, Barney describes some of the work of his students, explains how he became entangled with the MakingThings modules, outlines some of the aesthetic lineage of his type of generative art, and gives some tips on how to make art of out what was once surplus junk.

Symbiosis

Barney H.You recently had an end-of-term event where all the students showed their work…

The class is called “Interface” because it is about the intersection of technology and art. It satisfies an interdisciplinary requirement that all students have to take, so it has this great cross section of students from all the programs at CCAC. The college offers an array of disciplines including architecture, textiles, glass, industrial design, film, graphic design, sculpture, and painting, to name a few. So we get this really amazing mix of people with different sensibilities approaching this problem from multiple vantage points.

So how did it go?

There were a lot of great projects, 35 in all. There were kinetic sculptures, media installations, circuit bending performances, and ethernet amalgamations. Some of the work was really smart and highly crafted. There were some highly refined constructions that conveyed some exceptional ideas. This one student, Daimon Marchand, made this piece with cattails…

Cattails?

Yeah, and he had about 50 of them in a field. He set up a tracking system using a surveillance camera. So as you walk back and forth, your movement would vibrate the cattails. He mounted tiny motors on each one with solder dripped on the shaft as the offset cam…

Oh wow…

Yeah! So as you walked back and forth you could see different cattails vibrate mirroring your position, almost like a shadow. The tracking system was programmed with Max/MSP/jitter. He put a camera on the ceiling and used different math operators to reduce the video signal down to a very simple pattern of on/offs, and each cattail was activated by the state of a pixel using the MakingThings digital out modules. Another project by Maggie Simpson featured a glass eyeball in a bell jar. As the viewer walked around the room the eyeball would follow her/his position. It was quite elegant as she completely transformed the space into a surgical theater. The piece also used jitter to track position and the Teleo Servo module to actuate the eyeball. The sound of the servo motor and the slightly spastic behavior of the eye movement induced this creepy b-movie horror film effect.

There was also a nice collaboration between Andrei Pasternak and Kyle Mock: the sounds from a circuit bent speak and spell were analyzed and connected to motors via the Multi IO‘s PWM out, which in turn rotated 3 patterned disks mounted in a projector. There was also a performance by Guillermo Galindo that transformed gestures into frenetic mechanical actuated clanking. The show was particularly gratifying for the MakingThings people as they got to see their hard work and vision realized in such elegant ways.

How did you guys get involved with the MakingThings people?

For the last four years with Don Day and Todd Blair I have been teaching classes at CCAC that revolve around interfacing the physical world with computers. I do the Max/MSP/jitter programming, Don teaches the electronics, and Todd teaches fabrication. Todd is also involved with Survival Research as a fabricator and facilitator. It was there that he met the MakingThings folks, Michael Shiloh, Anne Swabb, and David Williams. Among other things they designed, built, and programed the control components of the machines. If you’re not familiar with SRL, their shows are like destruction derbies but the vehicles are cruel technological amalgamations, all dangerous, all vying to be the last machine twitching. The engineer’s mandate at SRL is to build electronics that can endure a lot of damage, like figuring out how to make circuits run while being abused by a flame-thrower. As might be expected in such an environment all the electronics have to be custom made.

Realizing that other artists would benefit from having access to these systems they decided to use this experience building bullet proof circuitry to make I/O modules for artists, musicians and scientists. The idea was to provide the means to be able to access this world so that artists wouldn’t have to get into PIC programming or complicated electronics. As part of their research they asked Todd, Don and myself to meet with them and discuss what we wanted as end users. We talked about the existing I/O modules on the market and their pros and cons. Through that conversation we realized that there was a certain affinity between us. We were really excited about their capabilities and the ideas they presented so we decided to enter into this arrangement where we and our students would serve as the beta testers for their modules.

What could be a better relationship? I mean, as long as the products are good. Can you give me a sense of how these units compare to what else is out there?

Most of the available controllers are skewed towards or only have input. The Making Thing’s modular system allows for custom configurations with a variety of input/output options. In addition to the Multi IO which has analog in, digital in, digital out, and PWM, they have a number of single purpose modules. If you are only interested in output you can purchase the digital out module. If your project requires control of beefy DC motors you can buy the 10 amp H-bridge module. They have a module that can control up to 8 hobby servos and they have an analog in module planned for release soon. The other major advantage is the protection circuitry built into all the modules. While a certain amount of caution is necessary with any electronic gear, with these modules I experiment with a lot more confidence when connecting sensors and actuators.

The Teleo modules have a dedicated Max object for each input and output. One problem I always had with complicated control patches is that you had one object dedicated to the IO device but a number of different sub patches for computation. Of course you can send/receive values, but I find in easier to embed the specific input or output object within its attendant sub patch. The Teleo Max object has really handy features such as scaling, range, and delta, and the computation is done in the module freeing up the computer for media hi jinx. Currently they connect to the CPU with USB, but they have other modules planned such as ethernet and RC. They are connected via a network cable that has the capacity to handle 63 modules, and you can mix and match according to your needs. Plus their tech support has been superlative.

Anyway, it was also one of our most successful shows as most of the projects not only worked, but worked well. The one problem we have – and it’s a good problem – is that students tend to be overly ambitious for a one semester class.

A few months is not enough time to learn all of the intricacies of max, I guess.

Yeah. Even though it’s great for artists because it’s a visual program, the learning curve is still steep.

Some would say that it has to be steep to maintain the flexibility that an artist needs.

Sure. To ease into it the first thing I teach with Max is how to cannibalize the help patches. I tell them that you may not understand what’s going on right now, but if you use this patch you get a specific result. Then when they see the possibilities they get hooked and start learning the intricacies of why this object is connected to that object… soon we’re actually going to teach a math class based around max.

Interactive Math

A math class?

Yeah.

Interesting! What type of math are you going to teach?

Well, I’m one of those math challenged art types so I’m going to co-teach it next year with this math whiz from the graphic design program. Over the course of this semester I’m going to show him Max/MSP/jitter then we can identify the types of math he will teach. The inspiration for this class comes from being utterly mystified by the innards of some of the example patches. I personally want to learn how to generate different sound and visual phenomena with math. It’s also a college wide requirement so why not teach algorithms within a creative context? It won’t be limited to media production. We will show how math can be used to calculate complex motion for mechanical actuation and for designing circuits. Teaching math with Max is part of a larger goal which is to develop an art practice at CCAC that reflects the Bay Area’s art and technology scene.

What, sort of a computer-centric…

Computers certainly play a central role but the art also requires an equal dose of physicality. The courses are designed so that students learn programming, fabrication and electronics concurrently. For instance one assignment is to measure physical phenomena and translate them into structural metaphors for media presentation. We discuss haptics or force feedback as a catalyst for causual sequencing or random permutations. We want to delve into quantifying biological data such as breathing patterns, heart rate and how sweaty your palms might be. This data could be propagated through a network or used to influence an installation. By merging disciplines compelling hybrids are realized, so the computer is an intrinsic component but without the familiar interface of keyboard and mouse.

This gets into an interesting area that I’m still grappling with: I’m sure you’re familiar with the laptop phenomena where you don’t know exactly what it is that you’re watching in terms of a performance. It’s interesting in a sense, it’s very punk or DADA to go and go up there and open up your laptop and…

Do “nothing”.

Yeah! Produce this intense wall of sound with absolutely no gestures whatsoever. I think that there’s something very compelling about that. Sound implies motion. What does it mean when movement is almost eliminated? The MakingThings I/Os offer a solution by making it possible to create gestural interfaces with sensors and switches. Or one could construct mechanical orchestras like the ones Matt Heckert and Gordon Monahan have done and program them with Max. However this freedom adds to the conundrum of computer driven music, performance or art. When you can ascribe any gesture to any sound how do you create meaningful connections? Is it pattern recognition, metaphor, is it deterministic or nuanced? Do you simulate interaction or is the piece reactive? We approach these questions as research confessing that we are in the process of developing our own conclusions. That’s the exciting thing about it, it combines research and art and process.

When you’re teaching, what kind of things are different about trying to get your students involved in interactive projects? Does this work require a different frame of mind than producing music, or producing a video, or anything else that’s not interactive?

It is a challenge. A lot of students have never been exposed to interactive work. So to break people out of that we have to immediately start talking about how meaning can be conveyed in non-linear structures. That’s why we start off with a random media or motion assignment. It forces them to consider chance and accident as form. We spend some time discussing this, and we point them toward the eu-gene list… it’s an email list, one of my favorites right now. It’s really interesting because its a forum about generative programming.

Generative?

Its hard to define, and a lot of the discussion centers on what is and what is not generative. Here is Phil Galanter’s definition: “Generative art refers to any art practice where the artist creates a process, such as a set of natural language rules, a computer program, a machine, or other mechanism, which is then set into motion with some degree of autonomy contributing to or resulting in a completed work of art”. One of the things you have to decide when you’re setting up these relationships, this idea of using physical phenomena to drive the media and machines, is how deterministic you want to be. If you make the exact same gesture does it repeat that gesture or is there something that interprets it and creates a counterpoint to it? Does this program interpret the heat of the room or your position within it – and just mimic it back in some way, or is there some kind of generative process that’s much more unpredictable and random? If you’re going to make a user interface, commercially the idea is to make it as intuitive as possible, right? We talk about this a lot in class: what is the nature of accessibility? Is it dependent on theory or is there an entryway that hooks the user in? What is interactivity? Can meaning be apprehended in cause and effect interaction? We want it to be intuitive, but does it have to be completely deterministic…

Repeatable.

Yeah, exactly. If you were a musician, and you’re going to perform, you’re going to want to know what you’ll get out of it. To me there seem to be all sorts of metaphoric, or fictional possibilities when things don’t exactly do what you think they’re going to do. So you can create these complex relationships that way…

Injecting some sort of randomness into the system?

Yeah, randomness or perhaps the system “remembers” how previous users have treated the thing, and reacts accordingly. As part of this discussion we have them do research projects where we point the students towards different email lists and web sites. Have you ever seen Steve Wilson’s technical artist list?

No.

He teaches over at SF State in the conceptual design program and has this truly amazing compilation of links that point to artists working in technology. They are organized into a slew of categories. In fact, he’s written this book called Information Arts that details the trajectory of art and technology. It’s one of the most exhaustive studies of this kind of work that I’ve seen. Anyway, we point them in these directions and they do research on how artist use technology. So through that, and through the work that we expose them to, we start corroborating different ways they can approach their art.

So at this point are there a lot of people MakingThings with the MakingThings things?

Actually they just started selling the modules this year. CCAC purchased a bunch of them and the SUDAC program at Stanford also bought some. On top of that there is so much interest that they’re just keeping pace with demand.

Aesthetics

What’s the aesthetic lineage of this kind of work? Who are some of the people that have influenced your thinking?

There are so many.

I guess the performance art world would be a strong influence?

Yeah. Laurie Anderson obviously is somebody who… I was kind of blown away by her early work. Then there’s Survival Research that had a huge impact. Miranda July does these performance/projection pieces using multiple screens on multiple planes. She brilliantly integrates the projection space of the image with her performance in this witty and natural way. I also get a buzz out of going to The Exploratorium.

I love The Exploratorium!

Yeah, I used to hang out there a lot.

I suppose really though, what you’re doing is new. This is technology that has only been around for a handful of years, right?

The technology is evolving to the point where you don’t have to have an engineering or computer science degree. Till the advent of Max/MSP/jitter and I/O modules such as the MakingThings products, with only a few notable exceptions artists had to collaborate with engineers to realize their projects. Not that collaboration between technicians and artist doesn’t produce great art, but if you tend to work more organically, experimenting without any designated closure, it can be frustrating for everyone involved. I come from a painting background and most of my work is informed by process as opposed to premeditation. When the tools become intuitive and you’re not penalized when you make a mistake the focus is on creative decisions rather than technical impasse.

What we are implementing at CCAC is a practice that is fluid and that embraces accident in a medium that demands a rational approach. However, I would be disingenuous in claiming that we have completely renounced logical process. Designing and building a robotic appendage with 5 degrees of freedom requires a little forethought. When Don, Todd, and I tackle a student proposal we often offer 3 different approaches. Todd is meticulous in his approach, Don will morph between Cartesian analysis and Cagian chance, and I tend to kludge or collage sections of Max Patches or chunks of machines into monsters. We are melding logical procedure and artistic process with materials and technology perviously unavailable to artists.

As well, the technology is new but the art is well grounded in a number of areas. There has been a subset of artists working with technology throughout the 20th century. It really picked up in the early sixties when film makers such as Hollis Frampton and Tony Conrad started exploring the material nature of film and the projection process. Content was denounced and effort was concentrated on the means of creating films like Tony Conrad’s The Flicker which had this intense physiological effect on the audience. With the advent of video, artists such as Nam June Paik and Wolf Vostell were iconoclasts questioning the sacrosanct reverence of the television by dismantling the trapping of the box and experimenting with the components. Concurrently Jean Tinguely constructed these amazing mechanical/kinetic sculptures some of which would self destruct.

Because you’re making pieces that are interactive, do you find it difficult… let me rephrase. I’m a musician. When I’m working on music I’m never really sure what other people are going to think of it. At the same time, I don’t have anything missing from my process when I’m working on it, and when I feel like I’m done then I’m done, I have my own methods of evaluation. When you’re working interactively, how do you know how your piece is going to be used or how successful it’s going to be until people are interacting with it? How do you solve that problem?

I guess I embrace it. Perhaps it’s all these years working in video where as the saying goes, “never the same color twice” (NTSC). Sure one tries to control the presentation of ones work, but at some point when there is a snag it has to become an opportunity rather than a disaster. When I made linear work I edited a different version for each screening. In one show I realized half way through the piece that I didn’t know which version it was. Admittedly this was very unnerving because some versions were never intended for the public.

When you engage in interactive art you have to relinquish control. It is more about the user’s experience with the art rather than the artist making the art. The piece becomes successful when it transcends the original intention. What are they going to select, and in what order? In some ways I find that difficult to deal with, but it’s fascinating to watch how people experience the thing. I sometimes feel like showing them what I’ve discovered about it, and I really have to fight off the urge to program those things so that they become part of the piece. When people find the stuff themselves…

It’s their own discovery. Makes it that much more special.

Yeah. To me it makes it a far more engaging experience when there is a little more nuance.

Junk

I’m just looking at the photos of the Symbiont project you have on your website now… wow, what an interesting presentation. I think it would make me really uncomfortable.

It was also uncomfortable to present. The first time I did this piece was in Germany. I really had no idea how people would react. I had one of those moments right before the opening where I seriously questioned my sanity. But they were very receptive. I always offered the option to opt out but everyone from octogenarians dressed for the opera to art damage types took a turn in the chair. The only snag involved the nipple speaker. Everyone gets a fresh nipple, but I thought I could speed things up if I changed them in between participants. I found out right away that putting on a fresh nipple was something you had to do in front of people in order for them to feel comfortable. The participants get to keep the thing, too.

A party favor! The screens are really interesting, too. Are they projection tubes?

One of them is a tube and one of them is an LCD panel. There’s a lot of great surplus around the Bay Area, as you might imagine. When they tear apart different dot coms as they go bust you can go down and get amazing machinery like robotic arms and different kinds of linear actuators…. I think of them almost as mechanical collages. All I do is bolt together these different parts that do the specific action that I want. I don’t have the kind of fabrication skills necessary to build any of these things. It’s interesting: you cannibalize machinery, you cannibalize patches… you do these things as an entryway to this kind of work and then you can start understanding the elements, the physics of how something works or the electronics or the programming of it.

I’m fascinated by the creative process necessary to work with these kinds of materials. How do you see art in something that was surplus junk?

[laughs] Okay, I’m laughing not because of the question but because it brings up some funny memories. We go down to these surplus places to buy gear and we’re looking at this really nicely machined, beautifully articulated junk, incredible stuff that has this super-fluid motion, and it’s almost like it has this fetishistic quality to it. One can get mesmerized.

Where do you go to get your stuff?

There are a couple of places down in the South bay near Silicon Valley. There’s this place called Triangle Machinery. To the uninitiated it’s an overwhelming experience… they have lots of cool stuff but without an engineering background you wouldn’t have any idea what to do with it. It took me four or five trips before I even tentatively bought something. If there’s a company that goes out of business, or a manufacturing company revamps their assembly line, businesses like Triangle just come in and buy the stuff as scrap and disassemble it into parts. In some cases they’ll leave sections intact so you can get parts like fully functioning linear actuators or robotic arms. So that’s where it gets exciting. For the piece in the movie, for example, I needed to come up with some way to put the nipple in someone’s mouth. That took a lot of iterations to make it right, to make it safe. I would go in and look for, say a robotic arm or a rotary actuator, and it was generally never quite right so I had to futz around and adapt it to my purpose.

In one sense finding junk or surplus and mining it for its aesthetic value has been a feature of Bay Area art for a long time. Going back to the Beat era and the artwork generated in the late 50s and early 60s, a lot of it was informed by junk. There’s been this kind of funky, garbage art that has become kind of a tradition. One route is to become a master dumpster diver. I have one friend who not only found everything he needed for his projects, but also made a lot of money selling aluminum. There’s an internship that you can apply for at the San Francisco dump where you spend six months there and they basically give you access to the garbage!

That’s amazing, an internship at the dump!

You can go out there and get anything that you want, what people throw away, and make it into art. I guess recognizing value in the stuff is sort of like pattern recognition.

So spotting artistic value in the garbage is something that you can only learn from experience.

Yeah, we try to accelerate the curve by demonstrating the potential aesthetic of these things by analyzing their behavior for alternative or subversive uses… a stepper motor can do all sorts of really very interesting kinds of motions, behavioral motions. You can make it go very slow, then ramp it up and down in very sophisticated patterns. Some steppers have great sonic qualities that are almost note-like. When I program my pieces half the decisions on speed and functionality are predicated on the sound quality of the motion. The problem with steppers is that they need expensive controllers to activate them. MakingThings is prototyping a stepper module as well.

In the Symbiont the nipple speaker is based on motor vibration. The sound is produced by two little motors connected to a consumer amplifier. They vibrate your teeth and your jaw so the sound resonates inside your head. There was a sensor inside the nipple to test your engagement, so if you stopped chewing it would go into rejection mode.

The nipple. It makes me uncomfortable even to talk about the nipple.

Ha! We don’t have to go there if you don’t want. I come up with these ideas, but I also have to live with them, and because I’m always there I have to explain it and watch people wince and get uncomfortable… I’m not impervious to this stuff, that’s for sure.