@September 05, 2019
In class we developed an interactive experience based on the song I wrote, recorded and produced called Carnage, and Beact, a beat making app Vibert Thio made.
We decided to design an Interactive Music Video experience.
Music videos are not usually made to be participatory. They visualize the song or live performance in an impressionistic way to be watched by a viewer.
The audience of a music video is a fan. The fan is a viewer and a listener and they usually watch the video via a web browser or app.
Other types of interactive music videos
Making the music video interactive could be done in various ways [1][2], such as a choose your own adventure style game, or a 360° perspective. Something most visualizations do not do is allow the viewer to manipulate the song directly.
Description
So, how could a fan view a video and also play along?
Imagine a music video is playing in your web browser. You see controls; you could use to interact with the song and video, or you could just sit back and watch.
The controls would be for interacting with the song's elements and to see the visualization respond.
The song's manipulable elements would be for high to low musical levels: rhythm, harmony, melody and timbre.
Rhythm
By manipulating the intuitive wheel-clock notation to visualize the songs rhythm, the user could increase or decrease the bpm or change the meter.
By deleting the circles that represent the percussion, they could simplify the song. By adding hits to the circles, they could make it more complex. If they wanted to do that live, they could use the keyboard keys to add hits.
Further visualization ideas: change the speed of day to night time or change the speed of the video playback.