yfeng95/face3d

3dmm fitting result does not look like the input image

zengxianyu opened this issue · 8 comments

The input image with landmarks:
bfm

and the result is not good.
Screen Shot 2020-08-12 at 12 08 22 PM
Screen Shot 2020-08-12 at 12 08 11 PM

Is this caused by fitting the 3dmm model using 2d landmark or BFM not working well for Asian faces?

I suppose the texture on the ears is from the color of the wall, based on the image.

I suppose the texture on the ears is from the color of the wall, based on the image.

The color is copied from the image and basically makes sense, but the shape is not correct (e.g., the nose and mouth

I suppose the texture on the ears is from the color of the wall, based on the image.

The color is copied from the image and basically makes sense, but the shape is not correct (e.g., the nose and mouth

Ok, I get what u mean now.
Ur inference is correct. Due to the sparse landmark constrain, we cannot fit the shape of the nose.
However, I guess u can try to use texture to help the algorithm fit it.

Hi,

Sorry to bother you but im new with python tools.

I try to generate a 3DMM from a picture.

Can you pls share the code u used to make the render.
That will help me a lot !

Thanks in advance !

@zengxianyu How did you do that? How can I input my 2D image and generate its 3D model?

https://github.com/ascust/3DMM-Fitting-Pytorch
this repo works better for fitting to 2D images

https://github.com/ascust/3DMM-Fitting-Pytorch
this repo works better for fitting to 2D images

@zengxianyu Thank you.

Hello, could you please share how you got the final 3D model from image? How did you get the texture, expression and shape parameter for BFM.

I go through the code and just find the function to fit the 68 key points (not image!) and return expression and shape parameter.