HomeMusicSocial MediaEditorialClothingAbout

Audio Reactive
Band Visuals





Shattered Sympathy is a band that is up and coming with a sound similar to the artist formerly known as Prince. I was commissioned to create a visualizer for their sets. For this project, I used After Effects and C4D to create videos, and then I used Touchdesigner, to effect the piece more. Utilizing Touchdesigner’s node system, I created effects that react to the audio, as well as a MIDI keyboard to change the parameters.

Video Asset Creation


The first step of this project was to create the assets. After communicating with the lead singer, I came up with five clips. 1: The logo animation. 2: An exploding skull. 3: A face emerging from curtains. 4: A video of a couple walking from the camera, and slowly becoming static. 5: A 3D TV to display the previous asset. C4D Build with Voronoi Fracture.
With a glass texture, and  a  backlight (rectangle above) I created the glint of light you see in the text.



Modeled, and animated the motion in C4D. Then I added a video overlay in After Effects, as a child to the TV movement.Here, I used a model of a skull, and then created a custom chrome texture, with floral patterns as a bump map to create the look of the skull.  I used
Above: The compositing of the 3D TV  in After Effects.                                            Below: Affected Voronoi Fracture of the skull.


Above: Node based shader in Cinema 4D.
Above: Test Render  of the mask through the curtain to see how the lighting texture, and smoothness
of the simulated fabric.
Above: Final Render
Above: Curtain mesh model.
Right: Layer build up of my model, including a fully functioning cloth simulation with turbulance (as wind).

T

ou

chDesigner



TouchDesigner is a node based software, with which I’m learning has infinitely many possibilities to manipulate and effect digital media.
Below: Screenshot of the entire system I built.
Below: If you look closely, you can see how this group of nodes acts to isolate specific sections of audio so that I can connect them to specific effects.The following section is where the videos I created are fed into a “switch
which alternates which video we see to the different beats of the song.
Below is what the MIDI mapping looks like. Each horizontal bar, is a different button on the MIDI controller, and the length has to do with how much it is affected. For example, I set different ranges of the color spectrum to three dials, making it convenient to create any color on demand.

Left:  Audio Analysis panel which seperates the different frequencies of sound, predicting which frequencies are the kick drum, snare, and overall rhythm. It also isolates low mid and high sounds with dials to tune what part of the sound you want to use. Then this gets translated into numerical values, which then effect the input of the effect.

Execution & Exploration


Below are some early stage exploration utilizing only TouchDesigner, and a specific effect called Feedback Edge. I mapped my MIDI controller to the parameters and started pushing buttons.
You can see that in the final version, the Feedback Edge effect “made it to production.” The effect makes the imagery feel far and close and out of focus, tying into the concept of an ending relationship, which is what the song is about. I projected my project with TouchDesigner’s  local Projection Map node, because I wanted to learn how to use it. Note, that I have never used TouchDesigner before this project, so this is my first attempt, and I’m excited to learn it more.