Patreon Peeks 40: Creating a Pikmin Visualizer! (Patreon)
Content
Hello! Recently, I got the chance to be a part of a HUGE collaboration of musicians online, organized by NoteBlock, to create a medley of music for each and every character in Super Smash Bros. Ultimate! Here's a link to listen, if you've got a free 26 minutes! https://youtu.be/2Kk01MoYmWc
And here's my own part isolated, which is what I'd like to talk about. Check the description for an instrument list! https://youtu.be/VlYZw-cybb8
Since each musician's part featured a video portion as well as audio, I got inspired by Animusic, the old collection of MIDI-driven music video animations, to create a visualizer for the melody of my part using Pikmin elements. I tossed ideas around like Olimar plucking Pikmin in rhythm, Pikmin carrying objects in a pattern that resembled sheet music, and the idea I went with: the Onion generating Pikmin seeds each note which fall according to the note's pitch. So lower notes would land further left, and higher notes would land further right.
I opened up a scene in Blender, imported an actual Pikmin Onion model (off of the Models Resource, thanks to Twilighter for uploading them!), and created my own low-poly Pikmin seed model. I gave everything flat, vibrant colored shaders, and then got to work creating an animating system to produce seeds.
Each Pikmin seed has keyframes that make it travel from the Onion's flower down to the ground, along with separate shape key keyframes to make its stem wobble. Meanwhile, it's parented to an empty object (the orange square in the above image), so I can rotate the empty object about the blue Z axis to turn the seed's orientation. The last keyframe I made was for a glow effect to come from the Onion's flower, and for the seed to be invisible until it started animating.
Now, I believe there are plugins out there for Blender that can take MIDI data and output it to animation parameters... but for such a short clip with not that many notes, it turned out to be easier to just hand-animate it all. So unfortunately this visualizer can't be used with other songs, but it at least worked fine with this one! This also allowed me to hand-adjust the exact location and rotation of each seed, so all of the seeds representing the note F didn't just land in the exact same spot.
The last consideration was the background, for which I created this trippy gradient shader:
The Camera View Vector node is dependent on which angle the camera is viewing this plane, and that plugs into the W axis of a 4-dimensional noise texture. That basically causes the noise texture to ripple and undulate pseudo-randomly. That noise texture plugs into two sharp green colors reminiscent of grass but moving a bit like water. That gets multiplied by view distance, meanwhile, to fade out the alpha of this material the further away it gets from the camera. That way you never see the edges of the plane, instead it has this smooth transition from psychedelic green ripples to a striking purple sky.
I can't promise anything, but if I ever get the free time to implement it, I'll find that MIDI-to-animation-data plugin and make this visualizer compatible with any single-instrument MIDI file.
Files
Previews only