Home Creators Posts Import Register Favorites Logout

Downloads

Content

I decided to play around with a program called EbSynth.

The basic idea is that you take some video, paint/draw over some keyframes, then it makes the whole video look like your art.

To that end I took an old 3D Kinsey I made a while back and had a go. Unfortunately it doesn't behave quite like how you'd expect. 

Instead of taking two keyframes and interpolating the frames between them using the information from both, it rather takes a single keyframe then generates frames to each side of it using the data from only that frame then crossfades the results.

This would work really well with a very loose, painty style, but not so much with clean line art.

There are a couple of things I could've done to improve this one, like making the dude bright green in the source video so that it could better distinguish (you'll notice it eventually thinks the dick is part of Kinsey). Likewise I could've done the same with her sweater.

Regardless, even with those fixes, the program really struggles with eyes, so it wouldn't be worth going back and doing it again until the entire process is improved and it can interpret multiple keyframes at once.

ANYWAY, here are the (only) four keyframes I used and the video in a zip.

Files

Comments

Goofy Ahss

holy shit Dave I didnt know you made slime girls! Good to know you still branching out lmao

Shali Wolfy~

"What is EbSynth? EbSynth is a free AI tool released by Secret Weapons on July 9, 2019, which allows for easy video style modification." "As a unique AI tool, EbSynth showcases impressive capabilities in the field of video style transformation." ....I see. Disgusting.

Teh Dave

Disgusting how? It's not generative AI if that's your concern. In fact the amount of hand drawn input it requires makes it barely worth it.

Jay Buds

Just remember, AI is only going to improve over time. Moving from here forward, this is the worst it's ever going to be.

Chungus

Would be interesting to see how well it works together with something like OpenPose and 3d to create a bit of a video -> 2d animation workflow. You could grab the video motion through open pose, easily key the 3d models so ebsynth can distinguish them cleanly. People raging against AI in art are fighting a rising tide. This is is its infancy and you can scream about it but its not going anywhere.

justavisitor

Needs some tuning, but i like where this is going. 👍

Morgan

Not bad. I think this might need more "key frames" to get things smoother and at that point your likely to be drawing a quarter of the total animation but it has some promise. Wouldn't mind seeing more tests of this nature to see how it grows.

Teh Dave

As I said in the post, the problem is less the amount of keyframes and more that the program is incapable of referencing more than one at a time. In theory you'd get the smoothest results with a single keyframe using the current implementation, as long as that keyframe referenced every detail that would be visible over the course of the sequence.

Versus

Little glitches aside I thought this turned out pretty awesome, for the most part.

LuaGrimm

It's not that bad tbh