Advanced audio analysis?

Jun 11, 2009 at 12:11pm

Advanced audio analysis?

Hi

I’m working on a project where audio analysis (not necessarily real-time) feeds parametric 3d models. I’m wondering if anyone has done or knows about audio analysis which goes further than the straightforward per-sample frequency and amplitude data.

I’m thinking of pitch, rhythmicallity (does this word exist?), texture (as in harsh/noisy versus smooth/soft), etc.

I’m aware of the fiddle, bonk and pitch externals which are candidates for developing a more complex analysis system.

I think a lot can be done just by analyzing frequency and amplitude over time. Any hints on algorithms are most welcome.

Tanx! Dieter

#44330
Jun 11, 2009 at 1:00pm

http://web.media.mit.edu/~tristan/maxmsp.html

a few more here… not sure if it’s what you’re after.

#159426
Jun 11, 2009 at 1:09pm

nice! gonna check m out

#159427
Jun 11, 2009 at 1:20pm

Check out our MEAPsoft package:

http://www.meapsoft.org/

not directly max/msp, but a lot of interesting analyses. Java source code is downloadable.

brad
http://music.columbia.edu/~brad

#159428
Jun 11, 2009 at 2:00pm

tanx man, a chunk-wise analysis like that is one of the ideas spinning in my head at the moment

#159429
Jun 11, 2009 at 3:14pm

These are new, and I have no idea if they will apply to you…. but they might!

http://www.e–j.com/sphpblog/static.php?page=zsa_overview

#159430
Jun 11, 2009 at 4:18pm

hey that s some cool new ej’s!

#159431
Jun 12, 2009 at 1:12pm

You might also want to look into FTM and Gabor, which have some tools you might find useful:

http://ftm.ircam.fr/index.php/Main_Page

M

#159432
Jun 13, 2009 at 7:42pm

anyone managed to get pitch data out of more complex compositions (eg. pop song)? fiddle and analyzer only seem to work with very clean sounds. (i do realise that s easier said than done…)

#159433
Jun 13, 2009 at 9:09pm

check my thread on the jitter forum, theres some useful things on there, ones I made and a link someone posted to an amazing one that works with polyphonic material.

Pop will be touch because its rhythm based, but you could probably adapt my fffb based method to work quite easily.

(its mainly just an fffb~ with frequencies for each area you want to analyze and cranked up reso and gain.)

#159434

You must be logged in to reply to this topic.