Cycling 74 » Topic: this might be fairly unrealistic… http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/feed Wed, 19 Jun 2013 05:32:36 +0000 http://bbpress.org/?v=2.2.4 http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/#post-30930 <![CDATA[this might be fairly unrealistic…]]> http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/#post-30930 Tue, 20 Mar 2007 13:23:13 +0000 Deklin …but I am a third year Creative Music Tech student and I was thinking about making a patch in Max and jitter (and any other software I might need) that analyses audio and visuals and text-based visual feedback for the user.
For example, I would like to have background ambient music and when the user stands in front of the camera, and as they speak or make a noise I want the textual representation of their words/sounds to float out of their mouths on the screen…

does anyone have any idea how to approach this? perhaps getting Flash, Max and speech recgonition software to talk to each other and also the sounds be processed in Max? I am an intermediate user of both flash and max but don’t know too much about Jitter…

]]> http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/#post-99603 <![CDATA[Re: this might be fairly unrealistic…]]> http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/#post-99603 Tue, 20 Mar 2007 13:46:03 +0000 Jean-Francois Charles

]]> http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/#post-99604 <![CDATA[Re: this might be fairly unrealistic…]]> http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/#post-99604 Tue, 20 Mar 2007 15:31:56 +0000 onar3d Deklin,

you will want to see Golan Levins work (http://www.flong.com/).

In particular “Mesa di Voce”, which is surprisingly similar to what you describe!

I do not know the specifics of how they were implemented though.

Regards,
Ilias B.

]]> http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/#post-99605 <![CDATA[Re: this might be fairly unrealistic…]]> http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/#post-99605 Tue, 20 Mar 2007 16:31:16 +0000 Deklin wow, Levins’ work is fantastic.

I thought flash might be more suitable to me due to my limited knowledge of Jitter. Macs come with a speech recognition program, Im not sure if it can communicate with Max or if it’s the best option. If the hardest part would be the speech recognition, I am happy enough to bypass it for the moment and create something similar to Levins by using shapes, and also like Elektroplankton, when these shapes interact, new sounds are created…

]]> http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/#post-99606 <![CDATA[Re: this might be fairly unrealistic…]]> http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/#post-99606 Tue, 20 Mar 2007 17:11:11 +0000 nathan wolek

]]> http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/#post-99607 <![CDATA[Re: this might be fairly unrealistic…]]> http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/#post-99607 Wed, 21 Mar 2007 18:33:10 +0000 mzed > For example, I would like to have background ambient music and when the user stands in front of the camera, and as they speak or make a noise I want the textual representation of their words/sounds to float out of their mouths on the screen…
>

Have a look at the aka.listen object here:

http://www.iamas.ac.jp/~aka/max/

If you want to use flash, you should look at flosc:

http://www.benchun.net/flosc/

which enables OSC communication between flash and Max.

mz

]]> http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/#post-99608 <![CDATA[Re: this might be fairly unrealistic…]]> http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/#post-99608 Sun, 25 Mar 2007 14:17:25 +0000 Deklin wow, aka.listen is really great! just what I need.

i managed to add quite a lot of words to it and it picks them up pretty much without flaw, but, I tried animating the text in Jitter and because I literally know nothing about it, I am finding it tough.

before I really get into it, I have a few questions.
is it possible to pick up interaction between visual objects in Jitter? i.e. when they touch?

How would I go about having the user be able to interact with the text on the screen with their hands? i.e. push it around the screen?

I have other questions but I can’t think of them right now

any help is beyond gratification!

]]> http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/#post-99609 <![CDATA[Re: this might be fairly unrealistic…]]> http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/#post-99609 Mon, 26 Mar 2007 10:08:33 +0000 Bas van der Graaff “before I really get into it, I have a few questions.
is it possible to pick up interaction between visual objects in Jitter? i.e. when they touch?”

There is no standard collision detection engine in Max. I’m interested in work on this subject myself. If you just need 2d collision for box-shapes or circles I’d imagine you could write it yourself in Java or Javascript.

“How would I go about having the user be able to interact with the text on the screen with their hands? i.e. push it around the screen?”

Only max-related work i know about is cv.jit:

http://www.iamas.ac.jp/~jovan02/cv/

I have no clue how well these work tho. I’ve used OpenCV (http://en.wikipedia.org/wiki/OpenCV) for motion tracking of hands myself, in a C++ environment, but all I can say about it is that it’s very difficult to get this working well. Calibration is difficult, we had users wear neon gloves in the end to get good results.

]]> http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/#post-99610 <![CDATA[Re: this might be fairly unrealistic…]]> http://cycling74.com/forums/topic/this-might-be-fairly-unrealistic/#post-99610 Tue, 27 Mar 2007 18:56:10 +0000 mzed > How would I go about having the user be able to interact with the text on the screen with their hands? i.e. push it around the screen?
>

Not so cheap, but sounds like a job for a touch screen:

http://www.elotouch.com/

mz

]]>