【Live2D App Progress 6】 Created the strongest hand tracking model yet 【*Three months in production for the arms alone.】 (Patreon)
Content
*This article is a translation of an article I published on Pixiv Fanbox on September 28., 2022.
It has been three months since I have been able to show you the progress of a new model.
It is not that I have been slacking off, but rather, I have been making and remaking models for three months... repeatedly.
During the process, I almost broke down many times thinking, "Is this really going to be completed? I was almost heartbroken, but I managed to make it to the point where I could show it to the public.
Wooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo!!!!!!!
Fully hand-tracking compatible model!!!!!!!!!!!!!!
Finally my dream has come true!!!!
This model can move all fingers!!!!
and allows for flexible hand positioning!!!!!!
reach out to the front of the screen
And it can move in accordance with the subtle movements of the body.
….What do you think?
I've been feeling very sick for a few days now, and today I have a headache and a sore shoulder.
But I'm so excited right now that I can't even think about it!!!!!!
(*Note: I will take a proper rest after writing this article.)
Hand tracking has been my dream.
Those of you who know me recently probably don't know this. How obsessed I have been with hand rigging.
~Following recollections
Before my 👇 debut (April 2018), I went out of my way to buy a leap motion (*hand tracking equipment that costs over $10,000) to try to move my hands…
https://twitter.com/himono_vtuber/status/981855219033128962?s=20&t=TA9diTDZMKDLiMKcir_HdQ
👇When Live2D didn't even have the ability to invert masks yet (2019), I just kept making hands for months…
https://twitter.com/himono_vtuber/status/1176171949946355714?s=20&t=AKpuagpJak5Rugpk5dFqbA
https://twitter.com/himono_vtuber/status/1182307823582998528?s=20&t=ffi9S1_RqPCxlPUEuvZLIA
https://twitter.com/himono_vtuber/status/1192841765029478400?s=20&t=x57RYh2Gj14HruFBiPQ0RQ
But no matter how hard I tried, at the time, my technology and the capabilities of the tracking app and Live2D were all in their infancy. I didn't have the technology to do real-time finger tracking, and even if I paid over $10,000 for a Leap Motion, all I could get was a wiper-like motion at best.
To begin with, it would be reckless to attempt seamless finger, hand, and arm joint movement in Live2D. Even top modelers' Live2D riggers for games make good use of hand transitions, and so do VTuber models. There are many people who create attractive movements by creating a lot of hand transitions.
A reckless challenge wears down the spirit. It was very difficult to keep up with the technology and functionality of what I wanted to do. Eventually, I fell into a severe slump with Live2D, and I was driven to the point where I had to suspend my activities.
Yet I wanted to seamlessly move the model's hands...
I wanted to move my hands...
It was VTubeStudio's hand tracking that rekindled my desire to do hand tracking, which I had once almost given up on.
I pulled out an unfinished model I had once created and gave it a try right away!
The modeling and movements are still a bit awkward, but I was excited to be able to "make use of what I have created"!
https://twitter.com/himono_vtuber/status/1456865642607362052?s=20&t=AeZH3RdJbB16ut60EQ6PzA
Since this feature was created, there are many more riggers trying to move their hands seamlessly.
The flames of my competitive spirit have flared up.
My desire to create arms that move more freely than anyone else's has grown stronger.
And so the "New Model Project" began.
It is no exaggeration to say that hand tracking is the most important goal of this model production.
It is not enough to just "move fingers" or "shake hands.
The goal is to create a complete hand movement that also incorporates delicate up-down, left-right, back-and-forth expressions according to the hand coordinates, distance from the camera, and body angle.
Production was difficult. Everything had to be managed by groping and brute force.
Making it simple.
Such a simple feeling did not work.
This is a battle with myself…
It was necessary to create a large number of correction parameters to control complex movements.
At one point, the polygons exceeded 100,000 and we had to rework them in a hurry.
I tried various techniques and approaches. I failed many times, and my PC screamed under the load.
Still, I didn't give up and worked on it little by little in between work and VTuber activities.
I would never make it in time for this year's contest, but I don't care about that anymore.
I'm willing to devote any number of years to complete this model.
...... and well, that's how we have been desperately working on it.
I apologize for not being able to show you the progress for a while, but behind the scenes, it was like this, so please forgive me.
I'm planning to publish several articles on arm modeling in the future, but to be honest, I've been pushing and shoving so hard that it would be tough to copy all the know-how I've learned, so please bear with me...sweat.
Finally, I'll do what I really wanted to do with this post!
It's a comparison to past models!
Isn't this amazing?????
Isn't my technological progress amazing ?????
I mean...
This arm is in the way!!! hahaha
That's all!