Will you release the trained checkpoints of MaskedMimic?

Question

Will you release the trained checkpoints of MaskedMimic?

Closed this issue 3 months ago · 8 comments

.

Answer 1 · 2024-09-29T12:08:13.000Z

We hope to release the model weights for both the full-body tracker (phase 1) and MaskedMimic (phase 2) and are actively working towards this goal.
Hopefully we will have positive news in the next few weeks.

Answer 2 · 2024-10-23T05:23:30.000Z

Any new developments on this?

Answer 3 · 2024-10-23T05:34:05.000Z

Yes, we've released the weights earlier this week: https://github.com/NVlabs/ProtoMotions/tree/main/data/pretrained_models/MaskedMimic

See the main readme for an example how to run.

Answer 4 · 2024-10-24T07:34:55.000Z

How to use the user command to control the humanoid robot, like language or keyboard input. Could you give a simple example?

Answer 5 · 2024-10-24T09:53:46.000Z

Just checking -- is it working ok or are you encountering any issues running?
I saw there was some issue, but you've since edited.

Answer 6 · 2024-10-24T11:26:48.000Z

I have fixed the bug by change the smplx to smpl and successfully run the code. But i still don't know how to control the humanoid by language or keyboard input.

Answer 7 · 2024-10-24T21:12:22.000Z

You can't control using the keyboard. What you can do in "user control" mode is specify some constraints through a YAML file.
I hope to add direct keyboard/mouse control in the future.

There's some more info on the user-control scheme in this thread: https://x.com/ChenTessler/status/1847923677020471799