solomonB

Is this possible to do in real time as a movie is being recorded via jit.qt.record? If not is there another way to do this? I want to grab certain frames from my webcam and make a running average of all the selected frames.

averaged-composite-of-all-frames-of-a-quicktime-movie

it's entirely possible but be sure to watch out for error accumulation

and saturation. I would recommend using float32 matrices for this

On Dec 24, 2007 2:00 AM, Solomon Bothwell wrote:

> Is this possible to do in real time as a movie is being recorded via jit.qt.record? If not is there another way to do this? I want to grab certain frames from my webcam and make a running average of all the selected frames.

it's entirely possible but be sure to watch out for error accumulation
and saturation.  I would recommend using float32 matrices for this
purpose over char matrices.

On Dec 24, 2007 2:00 AM, Solomon Bothwell  wrote:
>
> Is this possible to do in real time as a movie is being recorded via jit.qt.record? If not is there another way to do this? I want to grab certain frames from my webcam and make a running average of all the selected frames.
>
> thanks,
> solomon
>


Its good that these things are possible. It gives me hope I will finish this on time. Is there a way to update the current image in a matrix without sending anything to the jit.matrix' outlet? I want to route jit.qt.grab to a jit.matrix and then bang out the current data of the matrix into jit.qt.record only when certain conditionals are met.

Also, how can I pass every frame of a movie into jit.op for averaging all at once?

Its good that these things are possible. It gives me hope I will finish this on time. Is there a way to update the current image in a matrix without sending anything to the jit.matrix' outlet? I want to route jit.qt.grab to a jit.matrix and then bang out the current data of the matrix into jit.qt.record only when certain conditionals are met. 

Also, how can I pass every frame of a movie into jit.op for averaging all at once?


"Is there a way to update the current image in a matrix without sending anything to the jit.matrix' outlet?"

I meant to say "Is there a way to update the current data in the matrix without passing anything through it's outlet?"

Am 24.12.2007 um 13:13 schrieb Solomon Bothwell:

> "Is there a way to update the current image in a matrix without 

> sending anything to the jit.matrix' outlet?"

> I meant to say "Is there a way to update the current data in the 

> matrix without passing anything through it's outlet?"

>
> "Is there a way to update the current image in a matrix without  
> sending anything to the jit.matrix' outlet?"
>
> I meant to say "Is there a way to update the current data in the  
> matrix without passing anything through it's outlet?"


On Dec 24, 2007, at 12:00 AM, Solomon Bothwell wrote:

> Is this possible to do in real time as a movie is being recorded 

> via jit.qt.record? If not is there another way to do this? I want 

> to grab certain frames from my webcam and make a running average of 

One way to do this is to use a temporal low pass filter like 

jit.slide or jit.wake. The nice thing about jit.wake is that it has 

an internal 32 bit fixed point feedback buffer when working with char 

data which can be a little bit faster than jit.slide float32. Set 

jit.wake's bleed/gain/normalize attributes to zero, and just use the 

ff (feedforward) and fb (feedback). For example if you want the 

running average to be 1% of the incoming frame and 99% of your 

history, use @ff 0.01 and @fb 0.99. This is equivalent to jit.slide 

Or you could also use jit.gl.slab @file tp.slide.jxs @type float32. 

This requires that your graphics card supports floating point data 

(e.g. Intel GMA950 does not, but most ATI/NVidia cards do), but is 

much faster than floating point processing on the CPU.

>
> Is this possible to do in real time as a movie is being recorded  
> via jit.qt.record? If not is there another way to do this? I want  
> to grab certain frames from my webcam and make a running average of  
> all the selected frames.

One way to do this is to use a temporal low pass filter like  
jit.slide or jit.wake. The nice thing about jit.wake is that it has  
an internal 32 bit fixed point feedback buffer when working with char  
data which can be a little bit faster than jit.slide float32. Set  
jit.wake's bleed/gain/normalize attributes to zero, and just use the  
ff (feedforward) and fb (feedback). For example if you want the  
running average to be 1% of the incoming frame and 99% of your  
history, use @ff 0.01 and @fb 0.99. This is equivalent to jit.slide  
@slide 100.

Or you could also use jit.gl.slab @file tp.slide.jxs @type float32.  
This requires that your graphics card supports floating point data  
(e.g. Intel GMA950 does not, but most ATI/NVidia cards do), but is  
much faster than floating point processing on the CPU.

>One way to do this is to use a temporal low pass filter like 

>jit.slide or jit.wake. The nice thing about jit.wake is that it has 

>an internal 32 bit fixed point feedback buffer when working with 

>char data which can be a little bit faster than jit.slide float32. 

>Set jit.wake's bleed/gain/normalize attributes to zero, and just use 

Using ff and fb makes sense, but aren't you going to be staring into blackness

all the clouds turn to words / all the words float in sequence / no 

they mean / everyone just ignores them // Gregory Taylor 

>One way to do this is to use a temporal low pass filter like 
>jit.slide or jit.wake. The nice thing about jit.wake is that it has 
>an internal 32 bit fixed point feedback buffer when working with 
>char data which can be a little bit faster than jit.slide float32. 
>Set jit.wake's bleed/gain/normalize attributes to zero, and just use 
>the ff (feedforward) and fb (feedback).

Using ff and fb makes sense, but aren't you going to be staring into blackness
by setting those attributes to zero?

all the clouds turn to words / all the words float in sequence / no 
one knows what
they mean / everyone just ignores them // Gregory Taylor http://www.rtqe.net


On Dec 24, 2007, at 9:18 AM, Gregory Taylor wrote:

>> One way to do this is to use a temporal low pass filter like 

>> jit.slide or jit.wake. The nice thing about jit.wake is that it 

>> has an internal 32 bit fixed point feedback buffer when working 

>> with char data which can be a little bit faster than jit.slide 

>> float32. Set jit.wake's bleed/gain/normalize attributes to zero, 

>> and just use the ff (feedforward) and fb (feedback).

> Using ff and fb makes sense, but aren't you going to be staring 

Sorry. Gain should remain at the default of 1. But one doesn't want 

to change the bleed attr (unless one want's accumulated bluring), or 

normalize (unless you really want to normalize the output).

>> One way to do this is to use a temporal low pass filter like  
>> jit.slide or jit.wake. The nice thing about jit.wake is that it  
>> has an internal 32 bit fixed point feedback buffer when working  
>> with char data which can be a little bit faster than jit.slide  
>> float32. Set jit.wake's bleed/gain/normalize attributes to zero,  
>> and just use the ff (feedforward) and fb (feedback).
>
> Using ff and fb makes sense, but aren't you going to be staring  
> into blackness
> by setting those attributes to zero?

Sorry. Gain should remain at the default of 1. But one doesn't want  
to change the bleed attr (unless one want's accumulated bluring), or  
normalize (unless you really want to normalize the output).

it will help if you could shed some more light on gpu data types.

for example is the remap shader. how docan i use long type data?

On Dec 24, 2007 6:41 PM, Joshua Kit Clayton wrote:

> On Dec 24, 2007, at 12:00 AM, Solomon Bothwell wrote:

> > Is this possible to do in real time as a movie is being recorded

> > via jit.qt.record? If not is there another way to do this? I want

> > to grab certain frames from my webcam and make a running average of

> One way to do this is to use a temporal low pass filter like

> jit.slide or jit.wake. The nice thing about jit.wake is that it has

> an internal 32 bit fixed point feedback buffer when working with char

> data which can be a little bit faster than jit.slide float32. Set

> jit.wake's bleed/gain/normalize attributes to zero, and just use the

> ff (feedforward) and fb (feedback). For example if you want the

> running average to be 1% of the incoming frame and 99% of your

> history, use @ff 0.01 and @fb 0.99. This is equivalent to jit.slide

> Or you could also use jit.gl.slab @file tp.slide.jxs @type float32.

> This requires that your graphics card supports floating point data

> (e.g. Intel GMA950 does not, but most ATI/NVidia cards do), but is

> much faster than floating point processing on the CPU.

thanks for the wake tip.
it will help if you could shed some more light on gpu data types.
for example is the remap shader. how docan  i use long type data?

On Dec 24, 2007 6:41 PM, Joshua Kit Clayton  wrote:

>
> On Dec 24, 2007, at 12:00 AM, Solomon Bothwell wrote:
>
> >
> > Is this possible to do in real time as a movie is being recorded
> > via jit.qt.record? If not is there another way to do this? I want
> > to grab certain frames from my webcam and make a running average of
> > all the selected frames.
>
> One way to do this is to use a temporal low pass filter like
> jit.slide or jit.wake. The nice thing about jit.wake is that it has
> an internal 32 bit fixed point feedback buffer when working with char
> data which can be a little bit faster than jit.slide float32. Set
> jit.wake's bleed/gain/normalize attributes to zero, and just use the
> ff (feedforward) and fb (feedback). For example if you want the
> running average to be 1% of the incoming frame and 99% of your
> history, use @ff 0.01 and @fb 0.99. This is equivalent to jit.slide
> @slide 100.
>
> Or you could also use jit.gl.slab @file tp.slide.jxs @type float32.
> This requires that your graphics card supports floating point data
> (e.g. Intel GMA950 does not, but most ATI/NVidia cards do), but is
> much faster than floating point processing on the CPU.
>
> -Joshua
>

On Dec 24, 2007, at 9:37 AM, yair reshef wrote:

> it will help if you could shed some more light on gpu data types.

> for example is the remap shader. how docan i use long type data?

Typically you only have char and float32 at your disposal as texture/ 

output data. You can send a great deal of the 32bit long integer 

range as float32 data. 23-24bits of integer data if your card 

supports full float32 resolution. More info in OpenGL documentation 

(orange + red books), card specifications, and other online resources.

> it will help if you could shed some more light on gpu data types.
> for example is the remap shader. how docan  i use long type data?

Typically you only have char and float32 at your disposal as texture/ 
output data. You can send a great deal of the 32bit long integer  
range as float32 data. 23-24bits of integer data if your card  
supports full float32 resolution. More info in OpenGL documentation  
(orange + red books), card specifications, and other online resources.
.

Thanks Josh. jit.wake is exactly what I needed.

have a look at the cv.jit libary there are some very useful 

statistics objects. cv.jit.ravg is the one which might be interesting 

Am 24.12.2007 um 23:29 schrieb Solomon Bothwell:

> Thanks Josh. jit.wake is exactly what I needed.

have a look at the cv.jit libary there are some very useful  
statistics objects. cv.jit.ravg is the one which might be interesting  
for you.

>
> Thanks Josh. jit.wake is exactly what I needed.


averaged composite of all frames of a quicktime movie