Home Creators Posts Import Register Favorites Logout

Downloads

Content

*This article has been translated from an article posted on FAN BOX on October 3, 2023.

*The article in another language is in the PDF at the bottom.

https://x.com/himono_vtuber/status/1704056593586049237?s=20

https://x.com/nizimaLIVE/status/1704042777968025717?s=20

The day I've been waiting for has arrived! ! ! ! ! !

I actually wanted to post this article on the update day, but I was busy and ended up posting it late.

As the title says,

Finally, hand tracking function has been implemented on nizimaLIVE! !

Moreover,

I gave feedback and helped implement it! !

I also created a PR video! !

https://youtu.be/DEknueBD3HI

I just kept making "hands" using this app.

Then, I was invited to help develop the app.

I also participated in giving feedback to nizimaLIVE when it was released.

I also created a PR video for them. I have a lot of connections with them.

So I'm so glad they implemented hand tracking!

This is a core feature for advanced users.

So, you want to create and use hands with Live2D.

If so, what kind of tracking specifications would be easiest for you to create and use?

As a creator and user, I thought about this in various ways and conveyed it to them.

Although hand tracking is gradually being implemented in 2D tracking apps, the reality is that most "hand tracking" is for 3D.

I'm not an engineer. So I don't know the detailed circumstances of the hand tracking world.

However, the systems mainly used in this area are basically customized for 3D. Therefore, I know that if you try to use it forcibly with Live2D, various inconveniences will occur.

I think I wrote about this in an article some time ago. Hand angle Y and hand angle Z are swapped depending on the value of the model's wrist twist (angle X). This is the best example.

https://x.com/himono_vtuber/status/1414955650858299401?s=20

↑Here I am explaining about faces, but the exact same phenomenon occurs when creating hands.

When creating a 3D model, you only need to consider the angle seen from the hand. Therefore, the way the numbers are calculated for 3D hand tracking is basically set accordingly.

But with Live2D, I need to take that value as the "angle seen from the camera (us)."

If you use something designed for 3D, there will be various inconveniences such as the wrist not being able to move or moving in the opposite direction depending on the angle of the model's hand. In order to cover this, various efforts are required, such as incorporating complex physical calculations. However, no matter how hard we try, there are limits.

However, on the other hand, nizimaLIVE's hand tracking was developed for 2D from the beginning. So, I think you just create the model as you see it, and the model moves simply and beautifully!

↓As you can see from this, the way the model's wrists rotate is very soft.

https://x.com/himono_vtuber/status/1704062314385994084?s=20

That's also written in the tweet above. Being able to track the angle Y of the model's hand is a huge advantage. I think there are few people who can master this. (This is still difficult for me as well.) However, I think that if skilled people use this, they can create incredibly powerful moves.

There are many truly amazing creators in the Live2D hand tracking world. That's why I would like to see the amazing movements that such people make. I'm looking forward to the future...! ! !

That's all for this article. However, I also made some progress in modeling the lower body, which is not shown in the video. So next time I'm going to show it to you. (Actually, I was going to write about it in this article, but I can't finish my work. That's why I posted this first.)

Comments

No comments found for this post.