In an early project for the class Music, Computing, and Design taught by Professor Ge Wang we were asked to create an interactive sound visualizer with an audio-visual narrative component using C++, GL graphics, and ChucK.
The program used the FFT of the incoming sound to control the waves of an abstract ocean, knocking about an animated surfboard riding into the sunset, while the sun’s spiral graphics responds to the waveform of the same sound input.
Several control options were put in, including two alternate story mode endings. Both involved the setting of the sun and emerging of stars, but the music generated and visualized by the waves and sun created two distinct aesthetic outcomes for each story.
A documentation of the project including code is available here:
https://ccrma.stanford.edu/~adler/256a/hw2.html
A quick video demonstration:
