Re: live audio – video synchronization
Sep 22, 2008 at 12:48pm
Re: live audio – video synchronization
For many obvious reasons I did not initially develop a Midi reader
Up to now, whenever I was confronted with a Midi score I did one of
The current version can be used in a polyphonic situation (as the
Also, soon you’ll be able to synchronize pitched events (like midi
Hope this helps… .
Sep 22, 2008 at 1:03pm
sounds good to me :-).
I already prepared the score file manually, which isn’t too problematic for short pieces. For the actual sound, I used some inbuilt drums from Ableton. The wav file was used as audio input together with the score text file.
For some odd reason, the recognition wasn’t too good. Is there any specific hints/documentation when using antescofo for percussive stuff (drums etc.) ? maybe some pointers what could cause issues ?
and another question: What’s the relevance of the beat duration if the tones are not sustained ?
Sep 23, 2008 at 7:50am
Hi again Nick,
Note that Antescofo is a reactive system based on recognition. Therefore the AUDIO QUALITY of the analysis is of extreme importance and has nothing to do with the audio quality you’d want to achieve (for example) when using a harmonizer! Therefore to be able to answer your question:
Your second question was “and another question: What’s the relevance of the beat duration if the tones are not sustained?”
Realtime tempo detection in Antescofo is based on IOI (or Inter-Onset-Interval). So as far as you have the same score in Antescofo as for the musician, things should go with no problem.
Sep 23, 2008 at 8:17am
we are not sure yet on what drums to use exactly, potentially the bass drum and something else (to be more robust).
In terms of mic’ing it, again the option to use standard mic’s (I am not a specialist, don’t know about the specifics) or trigger microphones. If I am not mistaken,trigger mic’s don’t provide audio signals but rather impulses (on/off). In that case, the whole observation system wouldn’t need to be tuned regarding noisiness, compressors etc. The question is whether antescofo would then be appropriate as there wouldn’t be any pitch or midi information anymore to analyse.
How robust is antescofo in terms of missed notes/drum hits etc. ?
Sep 26, 2008 at 3:57pm
It seems to me that you don’t really need a score follower! What you really need is a tempo tracker that works smoothly on onsets (that you get from Bonk~ or others).
Ofcourse you can always use Antescofo in MIDI mode in order to get a pretty fair tempo curve. But you’d go to the hassle of having a score for it!
We have used Antescofo Midi synchronized with an orchestra just weeks ago with BBC Scotish orchestra and it worked smoothly.
Antescofo is pretty smooth in terms of missed notes/jumps etc. If you notice anything strange let me know!
But once again.. you gotta figure out whether your problem is really a synch problem or just tempo tracking… .
Sep 27, 2008 at 6:33pm
the requirements are shifting quite a bit, the more one finds out :-). As it doesn’t matter whether sync’ing visual effects or firing off audio effects at specific times, it should be more than just tempo “following”.
I used bonk the other day, loading it with 8 different drum sounds (bd, tom, snare, etc.). Then I streamed some audio from my sequencer, and bonk successfully recognized the different instruments, returning the respective id.
I shifted the values by 60, thereby making it appear like midi notes to antescofo (using standard mode converting midi to frequency).
For some reason, if there was the same note (instrument) played twice after another, it didn’t recognize the second occurence.
Any ideas ?
Sep 28, 2008 at 9:11pm
I’m happy that things are starting to move… .
For the case of “repeated notes”, make sure you somehow send in a NOTE OFF (pitch ZERO) to Antescofo, otherwise it’ll think you’re still on the same event without moving to the next event with the same pitch tag. That’s all!
For firing stuff, try the FWD, PFWD and LFWD commands.. . They couple with tempo in realtime and have proven to be quite musical and useful in performances… .
Let me know if there’s any other issues.
Sep 29, 2008 at 9:26am
I already used noteoff’s between repeated notes/drum hits. Still, at one point, antescofo recognizes the repeated note, the second occurence though is not recognized.
It’s hard to “debug” over the forum, I could send you a zip with :
- the wav file
Let me know whether I shall send it, don’t want to occupy you too much.
Oct 7, 2008 at 10:24pm
Just to follow up Nick’s problem with Antescofo… The problem was mysteriously solved! So the current distribution is for now solid. Do not hesitate to bug me with bugs!
A note: You do not need to put fake silences between notes! Antescofo automatically puts dummy silences between notes even if there’s no silence indicated in the score… .
You must be logged in to reply to this topic.