Last updated Aug 15, 2025
Written by Shinwon Lee
🏆 Swift student Challenge 2024 Distinguished Winner
Play melodies with your fingers using real-time hand tracking
Melody is a playful music app where your hands become the instrument. Using real-time hand tracking through the camera, the app detects pinch gestures between your thumb and fingers and instantly turns them into piano sounds.
Github Repository: https://github.com/LeeShinwon/Play-Melody
Figma: https://www.figma.com/design/Wj5qEUMYcSWQiuIiN8dRrf/Melody--SSC24-?node-id=1-2&t=RBjlRliPivNn8TeF-1
Demo Video: https://www.youtube.com/watch?v=Nsz66Aq19CE
App Store: https://apps.apple.com/kr/app/play-melody/id6749957721?l=en-GB&mt=12
The idea for Melody came from my own childhood piano lessons, which often felt repetitive and boring.