digiology

I wonder if anyone has an implementation for this? I'd need partial extraction similar to sigmund~ but I would love to get the synthesized sound to be as close to the original as possible.

http://mtg.upf.edu/files/publications/PhD-Thesis-1989-xserra.pdf)

 does partial tracking and synthesis and then subtracts that signal from the original in the frequency domain. If the phase is preserved it can be subtracted in the time domain.

If I have to implement this myself I would probably use sigmund~ and do the subtraction inside a pfft~ patch. I know that in Serra's paper he smooths out the noise as a smooth frequency contour so the general shape of the stochastic part is preserved and made more conducive to transformation through a simpler representation. I will probably try this out but maybe someone has a better implementation already made?

I'm only using this so that I can highlight partials and do time streching with the oscillator control data sigmund~ gives but to add a little realism to the signal.

It would also be nice to somehow avoid all the craziness sigmund~ produces during more turbulent parts of the signal (attacks), perhaps changing the noise/sinusoidal mix depending on amplitude fluctuations and zero crossing rate(noisiness)?

Any thoughts are much appreciated. I'm not wedded to using sigmund~ but something that'll give me control data for a collection of oscillators would be ideal while giving me the residual.

My final question is, how about that phase information on the sinusoidal part? Although I know it doesn't matter perceptually, I would like a way of preserving this because of my project's technical needs (I'm too much of a noob to implement partial tracking myself).

Xavier Serra's dissertation (http://mtg.upf.edu/files/publications/PhD-Thesis-1989-xserra.pdf) does partial tracking and synthesis and then subtracts that signal from the original in the frequency domain. If the phase is preserved it can be subtracted in the time domain.

If I have to implement this myself I would probably use sigmund~ and do the subtraction inside a pfft~ patch. I know that in Serra's paper he smooths out the noise as a smooth frequency contour so the general shape of the stochastic part is preserved and made more conducive to transformation through a simpler representation. I will probably try this out but maybe someone has a better implementation already made? 

I'm only using this so that I can highlight partials and do time streching with the oscillator control data sigmund~ gives but to add a little realism to the signal.
It would also be nice to somehow avoid all the craziness sigmund~ produces during more turbulent parts of the signal (attacks), perhaps changing the noise/sinusoidal mix depending on amplitude fluctuations and zero crossing rate(noisiness)?

My final question is, how about that phase information on the sinusoidal part? Although I know it doesn't matter perceptually, I would like a way of preserving this because of my project's technical needs (I'm too much of a noob to implement partial tracking myself).


sinusoidal-stochasticnoise-decomposition

Just wondering if anybody else has tried this or have an implementation of it in max. Today I tried frequency domain subtraction to remove sinusoidal components (from the sigmund partial tracking patch) and I must say it works quite well! You can retain just the attack/noise or add both signals together to reconstruct the original signal roughly.

Constructing some simple model of the noise component would be nice, in Serra's thesis he used filtered noise with the overall shape of the noise spectrum modeled with a break-point function I think.

Hello digiology, I am very interested in this question !

I found X. Serra's work some month before, and I would really like to be able to test the harmonic/noise separation in Max!

Do you have an implementation of your work ?

I posted an implementation in this thread: 

https://cycling74.com/forums/monophonic-pitch-shift-real-time-timbre-neutral

You'll need the sigmund~ external. Because this doesn't retain the phase the subtraction has to be done in the frequency domain (in a pfft~ object).

The sine wave model isn't perfect but listening to the noise part on its own is surprisingly good if you're looking for that effect.

I posted an implementation in this thread: https://cycling74.com/forums/monophonic-pitch-shift-real-time-timbre-neutral you can ignore the pitch shifting part.

The sine wave model isn't perfect but listening to the noise part on its own is surprisingly good if you're looking for that effect.


Thanks for the answer . Unfortunately, I cannot do any test because I don't have a Mac, and sigmund~ isn't available for win.

Do you think you could test your separation tool with the file bourdon8.wav that I've posted on :

https://cycling74.com/forums/partial-tracking-for-noise-reduction

It is normal that the SNR is the low (I choose on purpose this one, from all the samples that I've recorded, because this is one with the lowest SNR!)

Hey digiology,
Thanks for the answer . Unfortunately, I cannot do any test because I don't have a Mac, and sigmund~ isn't available for win.

Do you think you could test your separation tool with the file bourdon8.wav that I've posted on :
https://cycling74.com/forums/partial-tracking-for-noise-reduction

sigmund~ is available for Max on Windows, compiled by Rob Clouth. you can find it at maxobjects.com:

http://www.maxobjects.com/?v=objects&id_objet=4713

sigmund~ is available for Max on Windows, compiled by Rob Clouth. you can find it at maxobjects.com:
http://www.maxobjects.com/?v=objects&id_objet=4713


I've used residual noise in non-realtime quite a bit, so I know what you're after. (SPEAR works in non-realtime.)

I wonder if you could skip sigmund~ and go straight at some kind of statistical analysis of the fft~. Maybe zero out bins that are much louder than the surrounding bins? Or, set some kind of limiter on bin amplitude... perhaps low-passing the amplitude stream in pfft~?

I've used residual noise in non-realtime quite a bit, so I know what you're after.  (SPEAR works in non-realtime.)

I wonder if you could skip sigmund~ and go straight at some kind of statistical analysis of the fft~.  Maybe zero out bins that are much louder than the surrounding bins?  Or, set some kind of limiter on bin amplitude... perhaps low-passing the amplitude stream in pfft~?


Sinusoidal & Stochastic/noise decomposition