Send Video/Jitter to Media Pipe via Javascript (node)?

Jacob's icon

Hello,
I'm using Google's Media Pipe, Pose ML body tracker (https://google.github.io/mediapipe/solutions/pose.html) in a project

I'm communicating info from that tracker to Max via the JS code they include.
I'd like to send an IR image of a person from a Kinect that I've processed in a Max patch TO the Media Pose JS program to use that IR image to be body tracked my Media Pose source.

So far the only camera/video in options that I can for the tracker are the built in camera, and maybe an external camera/web cam.

Is it possible to send video from Max/Jitter to the Media Pose?

I'm new to integrating JS and other cross-program stuff into Max, and although this description is vague, I appreciate any suggestions for being able to transmit video/matrix data to a Media Post JS program, if that's even possible, or any general work-arounds if it's not.

Thank you!
J

Rob Ramirez's icon

first thing I would try is sending syphon/spout streams to apps that will turn them into webcam feeds.

Jacob's icon

Thanks I'll check this out and post back.

Jent Zheng's icon

I am quite new to Jitter. Would it be possible to use navigator.mediaDevices.getDisplayMedia() to get stream from jweb's window? it should prompt the user to choose the screen area to share, but i'm not sure if jweb has the system permission for screen sharing.

Rob's OBS virtual cam could be an option. but what if I have multiple sources to be detected? then seems OBS doesn't support multiple virtual cam?

How about using networking sth like NDI or jit.net.send? any JS code that can read video stream from Jitter?