Glitchface :: Jitter 3D mesh webcam audio reactivity

This experiment takes in webcam image and turns it into a 3D mesh (see my Selfie Sunday 001 tutorial for a full video guide on achieving this).

Everything is automated via the “loudness” value from the audio input system.

The Frame Buffer Glitching stores the last 40 frames of webcam, and only plays them back when the loudness reaches a threshold. It randomly jumps through the frames – meant to enhance the louder, more frantic moments in music. Otherwise, the image goes through a smoothing process in order to suit more ambient moments of music.

The webcam image is then stored as a texture to colour the mesh at the end. It’s also turned into a luminance image, and put into the 5 plane matrix to prepare it for the [jit.gen] – where the luminance value then deforms the z position of the mesh. The BFG noise deformation matrix is also sent into the [jit.gen] object to morph the x and y vertex positions of the mesh.

Track in video: Unreleased by Woulg

[PATCH D/L ON WEBSITE]