0 4
scroll
Sound-based video manipulation

Sound-based video manipulation

Original

The original video can be seen here:

How we did it.

Sound-based video manipulation

With P5.js its possible to get sound values from mp3 files. We split the mp4 to mp3 and video, got the sound values and implemented it in a shader.

WebGL

Sound-based video manipulation

WebGL made it possible to dynamically update video images based on sound.

volgende experiment: Beatbox Sampler