radekd91/inferno

The technical details of EMICA?

weihaosky opened this issue · 2 comments

weihaosky commented

Thanks for this excellent work!
In the readme, it says EMICA is a combination of DECA, EMOCA, SPECTRE, and MICA, but without any details.
May I ask how do you combine these methods to propose EMICA? Is there any documents (e.g., paper, technical report) introducing the EMICA?
Many thanks!

radekd91 commented

In short, MICA's prediction for shape, another encoder that predicts camera and pose, and one more encoder that predicts the expression, that one is supervised with EMOCA's and SPECTRE's loss.

There is no paper or technical report. It's just a bit of engineering combining existing papers together. You can use it through the FaceReconstruction demos. If interested, you can step through the code.

  • 👍1
weihaosky commented

Thanks for explaining! Did you train the encoder that predicts the expression from scratch?