PUBLIC MARKS from sbrothier with tags WebGL & video

In this demonstration, we build upon the previous example by replacing our static textures with the frames of a playing Ogg video file. This is actually pretty easy to do, but is fun to look at, so let's get started. Similar code can be used to use any sort of data (such as a canvas as the source for your textures.

There are a few different ways to sync visuals to music: Manual – live controlling visuals with keyboard or midi controls. Sequencing – pre-analyzing the music and scripting an animation as a list of timecoded events. Midi Input –  if you have access to the music’s midi data, this can be a great way to drive visuals. Audio Reactive - code driven visuals that automatically adapt to a live audio input. Here I want to talk about the last method. This can be useful for “Hands Free VJing”, allowing you to sit back and have the visuals automatically sync, or in a video game where you want some part of the visuals to react to the soundtrack.