mks0601/ExAvatar_RELEASE

animate avatar using simple SMPL pose parameters

Closed this issue · 2 comments

gt732 commented

Hi,

Thanks for the hard work here! I was able to get good results following the instructions. Here is my personal avatar!

1001.2.1.mp4

My question is how can I animate my avatar by using simple SMPL pose/camera parameters, I tried following the fitting code to get an understanding but it looks like the model uses a special format that comes from the SMPL optimized after the fitting run.

I would use fitting on a video from the wild but it can take hours just a small clip.

Can we use SMPL parameters from projects like:

https://github.com/brjathu/PHALP

https://github.com/mkocabas/VIBE

https://github.com/mkocabas/PARE

Also the paper mentions real time inferencing is possible with the avatar, any resources or code snippets you can point me to?

Thanks!!

mks0601 commented

ExAvatar requires SMPL-X, not SMPL parameters. SMPL parameters do not have hand/face information, and body kinematic chain is slightly different from SMPL-X.

gt732 commented

@mks0601 makes sense, thanks! I'll look into getting the SMPL-X parameters and trying that.