Patreon Peeks 14: Creating "Painted Footage" of Breath of the Wild (Patreon)
Content
Hello! Today I'm especially excited for this behind-the-scenes look: the painterly effect I applied on clips of The Legend of Zelda: Breath of the Wildfor my video on its sound design, which you can see here: https://youtu.be/Vgev9Gzybk8
This was a doozy of an effect, and the major reason the video took so long to complete. Each frame could take an average of 10 seconds to render, and it took a lot of trial and error to get an effect that could bring out the painting-like colors of BotW, wash the video for transitions, and blur it enough to be a background for other content. Let's break it down using an example screenshot:
The video was one of my last videos in a lower resolution than 1080p, but this effect worked best with images at a higher resolution than the video. I'll explain shortly. First, we import this image into After Effects, and, in a 960x540 window, it's really big:
Instead of just scaling down the layer, I use a Transform effect to scale down the image without scaling the layer. Visually it's the same thing, but this will be important so that I can play with effect scales later.
Next, add a subtle texture around the whole thing to mimic a canvas.
Then we get to the meat of the effect: Brush Strokes. Photoshop has a filter called Brush Strokes that will smear strokes of color over the image to very loosely emulate the look of an impressionistic painting. After Effects has this same filter, but it can recalculate each frame. However, the size of each brush stroke can only go so high, making for a relatively small-looking brush. BotW needs big brush-strokes, hence using the Transform effect to artificially shrink the image. This way, the image is 50% the size, but the Brush Strokes effect is 100% its size, making the brush strokes appear twice as big.
Next comes several more effects to blend these harsh strokes. First is Echo, an effect in After Effects that will blend several previous frames on top of the current one.
Already an improvement. Then I add a Scatter effect to granulate the brush strokes and stark color contrasts a little more.
And finally, because Scatter is not very anti-aliased, a tiny bit of Gaussian blur to set the whole image.
And there you have it. Each frame takes a while to render, but you can pause on any frame and get this vague but appealing wash of painted color. I think it only really worked because BotW already looks like a painting; its colors choices are very distinctive.
Every time I use this effect in the video, I play with it. Sometimes parameters of this stack of effects will change over time to create a transition from raw footage to "painted footage." Sometimes I'll shrink the image to, perhaps, 25% rather than 50%, so that the brush strokes appear even bigger. There's so much variety to be tried with this big a tower of filters. And the effect is a spice: it flavors the video footage and blends sections of the video together. It went a long way for me; I believe the wait for it to render was worth it. Here's one more breakdown, in one image:
I may make this information public somewhere down the line, as an addendum video, just because I'm so happy to share it with everyone! Thank you very much for reading it!
Files
Previews only