P5 Sketch: https://editor.p5js.org/my3037/full/ZqitQPjFt

Writeup:

FaceMesh Liquid Glitch Mirror is an interactive, webcam-based visual experiment built with p5.js, ml5.js, and p5.sound that transforms your live reflection into a fluid, reactive piece of glitch art.

Using ml5’s FaceMesh model, which tracks 468 facial keypoints in real time, the program distorts your image through pixel manipulation and motion-based transformations, turning your face into a dynamic controller for digital effects.

The sketch features four main distortion modes—Mosaic, Ripple, Glitch, and Blend—each altering your face differently.

Mouse motion increases distortion, mouth openness enhances the ripple, and eyebrow raises amplify glitch intensity, allowing your emotions to directly shape the visuals.

Optional sound interaction adds another layer, where a synthesized tone rises in pitch with eyebrow movements and grows louder as you open your mouth, creating a real-time audiovisual link between expression and sound.

Documentation: