Glitchface :: Jitter 3D mesh webcam audio reactivity


    Glitchface :: Jitter 3D mesh webcam audio reactivity


    This experiment takes in webcam image and turns it into a 3D mesh (see my Selfie Sunday 001 tutorial for a full video guide on achieving this).
    Everything is automated via the “loudness” value from the audio input system.
    The Frame Buffer Glitching stores the last 40 frames of webcam, and only plays them back when the loudness reaches a threshold. It randomly jumps through the frames – meant to enhance the louder, more frantic moments in music. Otherwise, the image goes through a smoothing process in order to suit more ambient moments of music.
    The webcam image is then stored as a texture to colour the mesh at the end. It’s also turned into a luminance image, and put into the 5 plane matrix to prepare it for the [jit.gen] – where the luminance value then deforms the z position of the mesh. The BFG noise deformation matrix is also sent into the [jit.gen] object to morph the x and y vertex positions of the mesh.
    Track in video: Unreleased by Woulg
    [PATCH D/L ON WEBSITE]

    • Feb 17 2016 | 12:06 am
      Your SelfiSUnday tutorials get the big thumbs up> Thanks for doing them.
    • Feb 17 2016 | 5:18 am
      Great work! I have a couple patches in the works with some similar concepts that I'll send your way if you're interested in trading notes :)
    • Feb 17 2016 | 9:47 am
      Thanks both!
      TCONNORS - I've been caught up with other work - but there will be more :) DUFFIELD - Always interested in trading patchers. You can email me from my website.
      Chris.
    • Mar 25 2016 | 5:53 pm
      Hello, wonderful patch :) . Is there a simple way to use vídeos instead webcam?
    • Mar 25 2016 | 5:53 pm
      Hello, wonderful patch! Is there a simple way to make this work with vídeos instead webcam?
    • Jul 24 2019 | 6:37 pm
      Hello. Nice one. I am really interested in that sort of process.