Low latency video input – seemingly impossible!
I apologize for the long message but it includes some useful resources that attempt to clarify the problem. I’ve had this problem for a number of years and have yet to find a reasonable solution.
How do I get low latency video from an external camera into jitter (or any software for that matter), perform simple manipulations and then send it out to a projector?
I need the projected image to not apply a noticeable delay to the original source. If I am filming someone talking I want the sound coming from their lips and projected image to appear "live" without latency. I’m at the point where I’d like the image to be better than SD but will settle for anything.
A humble request in 2012 with such powerful computing power no?
I have a very fast macbook pro laptop with great graphics card and a thunderbolt connection and firewire 800. I also have a Mac Pro desktop.
I own a canopus advc55 firewire and have tried many many different cameras with it. I still can’t achieve low enough latency. I’ve found that analog cameras seem to work better than digital cameras with analog outputs but it’s still not good enough. I’ve tried the same camera setup in modul8 and isadora with similar latency results. I assume this means that it doesn’t have to do with jitter or my not so great jitter programming.
I read about the new Blackmagic intensity. Sounds great! but after reading this thread (http://cycling74.com/forums/topic.php?id=38378) it doesn’t seem like a solution, especially considering that it uses the only thunderbolt port and can’t daisy chain to allow a projector. Lame!
It was suggested that the DFG 1394-1e was a good option but it is now discontinued. The Matrox MXO2 Mini seems ok but again doesn’t solve the thunderbolt daisy chain problem.
Frieder Weiss developed the Eyecon system and created an amazing visual system for Chunky Move. He suggests the FALCON PCI Bus Framegrabber. Unfortunately it will not work with a laptop and I don’t even think it works on Mac.
Vade wrote this article 5 years ago discussing an older intensity card but says that it "requires some fairly in depth knowledge of Jitter," to make work.
So after all of this I still am left without a solution. It’s frustrating because it seems like a simple operation that many people would want to do.
Are there any options left aside from getting a PC with the Falcon grabber?
Your best bet is to get a PC running windows xp.
Get the aiptek 5900 dv cam
It works as a high quality webcam.
(Onboard software controls let you control sharpness gamma contrast ect.)
It can be output live via its software that comes with it.
I used the same setup and displayed footage real time that I could tweak and control on my projector.
Matrox does make a PCI-e card for the MX02 mini – I have one and this works well in my Mac Pro tower. I also have the Expresscard interface, but you need a 17" MacBook Pro to make that work. Have not tried the Thunderbolt option and I likely won’t.
People have also reported good luck with using the Intensity Pro PCI-e card from Blackmagic, which is a cheaper system.
any update on this? I’m also searching for a portable low latency video input solution for the current MacBook Pro with Thunderbolt and USB 3.0. But it doesn’t have an Expresscard slot anymore. How is the latency with the MX02 mini?
Beware of the Matrox MX02 Mini. I have one with the PCI interface and there is a very long latency (feels like 1/4 or 1/2 sec!). I also have the BlackMagic Intensity PCI card and there is hardly any latency (about 1 frame). I assume the thunderbolt version is similar but I’ve never tried it. (Bummer about the lack of thunderbolt passthrough though.)
FYI: There is no "in-depth knowledge of MAX" required beyond the OpenGL optimizations that should be used for all capture and rendering pipelines anyway. (Capture in uyvy with "@unique 1", do rgb conversion with a shader, only bang the OpenGL renderer when a new frame arrives, etc) See the opengl tutorials and search for vade’s "jitter movie playback optimizations" for ideas. I think he mentioned the "in-depth knowledge" because that blog post covered several programming systems and some of them are more optimized out-of-the-box.)
You will never get low latency with a camera connected to the Canopus box because it converts your cam’s analog SD signal to DV which then must be decoded on the CPU causing unavoidable latency. I have the DFG box for analog SD capture and it has virtually no latency.
Overall I’m leaning toward the Intensity for your application.
Thanks for the advice. I’ll check out the Blackmagic stuff. If anyone has experience with either the Intensity Shuttle or Extreme, please tell. Seems like the Shuttle USB 3.0 doesn’t work with Mac. For Mac you need the Thunderbolt version.
I’m needing low latency for live processing of staged video capture (theater project). I’m also needing to upgrade my macbook from several gens.
I’m eyeing the BlackMagic Extreme for capture from hdmi (directly from an HMC-40).
I am wondering if any one has had experience with the new retina macbook pro that has onboard hdmi out. Would that solve problems of Jitter not being able to consume and broadcast a signal through the thunderbolt port – since you could broadcast out the htmi port instead?
I ask, because otherwise i would stick with the non-retina macbook pro to keep my firewire800…