The original video can be seen here:
Sound-based video manipulation
With P5.js its possible to get sound values from mp3 files. We split the mp4 to mp3 and video, got the sound values and implemented it in a shader.
WebGL made it possible to dynamically update video images based on sound.
Work with us.
We can help you with new online experiences or fix existing problems.Message us about anything.