problem with movements

[marsiliflavio]

Hi,
stantastic job. But i have a problem with certain mouvement as wrist rotation, rotation of the hand with the palm facing the face, etc. Some movements despite the fact that Mixamo's models do not preclude constraints in movements, are not done correctly. My shooting is total body. Also if I try to place my hand on my ear it is rather inaccurate and does not bend my wrist

thanks

[marsiliflavio]

Hi, stantastic job. But i have a problem with certain mouvement as wrist rotation, rotation of the hand with the palm facing the face, etc. Some movements despite the fact that Mixamo's models do not preclude constraints in movements, are not done correctly. My shooting is total body. Also if I try to place my hand on my ear it is rather inaccurate and does not bend my wrist

thanks
I try to bend or rotate the octopus but nothing happens
thanks
Flavio

[Neleac]

The problem with wrist rotations is that MediaPipe's body and hand landmarks both use local origins as opposed to a common world origin. Therefore there's no way to get the relative orientation between the hand and the arm.

In theory the body landmarks alone should handle wrist rotations since it has some hand landmarks, but it does not detect palm facing direction (flaw with body pose estimation model).

[marsiliflavio]

Thank you very much for your helpfulness
F

[marsiliflavio]

Another issue, I do not understand how you use the individual fingers of your hand. It seems that you only use the index, middle finger and the pinky. But in reality I then see that you map all the fingers. Could you show me how the mapping works?

thanks
Flavio

[Neleac]

See solveHand, I loop through all the fingers and solve their joint rotations, using the same approach as the body joints. Additionally, I apply some rotation constraints so the fingers don't become mangled. The hands are much more prone to noise compared to the body, since the fingers are so close together.