https://editor.p5js.org/Raven2950/sketches/XDW58gb3e
My initial goal was actually very simple:
I wanted to create a special effect like Doctor Strange's "hands can attract explosive particles".
At first, I only made a cloud of dots floating on top of the camera video, and made the particles move closer to the palm when I clenched my hand, then explode when I released it.
Atlantic citipati by Raven2950 -p5.js Web Editor
https://drive.google.com/file/d/1VKeUKhv4qOKhxXe9wq3seP3YGpLJKtql/view?usp=sharing
This effect was quite fun, but the number of particles felt insufficient, and the video captured by the camera as the background seemed to interfere a lot with the visual effect of the particles.
At this point, I remembered the program I wrote when I collaborated with Jisoo before. At that time, we converted the video into complementary color pixel blocks.
So I thought that I could directly convert the entire video into particles. This way, it not only enhances the overall visual effect of the particles, but also allows people to see the human form, and it's more convenient for people to control the gathering and dispersing of particles by observing the position of their own hands.
Autumn orangutan by Raven2950 -p5.js Web Editor
https://drive.google.com/file/d/1oLHGj8mjAXXh05ZTw9Q_AyuanD0R_z-j/view?usp=sharing
I'm quite satisfied with this visual effect, but it feels dry without sound, like something is missing. At this point, I remembered a project I collaborated on with Anna, where we used color changes to control the pitch.
So I first added tink/triangle style metallic tones to pinch and release.
Valiant watercress by Raven2950 -p5.js Web Editor
https://drive.google.com/file/d/1KUnVUE44Yw2GDw3JidHi9g4S0AzKHXVV/view?usp=sharing
When playing with this effect, I felt that it would be better if my hand could make sounds like plucking strings just by casually sweeping over the particles, even without making absorption or explosion movements. Therefore, I added a third type of sound interaction: there will also be sounds when sweeping the particles.