The original video can be seen here:
Sound-based video manipulation
With P5.js its possible to get sound values from mp3 files. We split the mp4 to mp3 and video, got the sound values and implemented it in a shader.
WebGL made it possible to dynamically update video images based on sound.
Work with us.
We are experienced with everything on the web.
* Except for spiders.