MarekKowalski/DeepAlignmentNetwork

some questions about these pre-trainedmodels

Liz66666 opened this issue · 9 comments

Hi,
I have download these three models: DAN.npz, DAN-Menpo.npz, DAN-menpo-tracking.npz, but I don't know the difference between these models.
And I have download menpo training dataset, but it needs password to unzip, can you share the password or tell me how to get this?

Hi,
For the password please contact the owners of the menpo dataset: https://ibug.doc.ic.ac.uk/
As for the different models, please take a look at the readme.txt file that is placed in the same directory as the model files.
For convenience I am pasting its content below:

The DAN and DAN-Menpo models are the ones used in the following article:
Deep Alignment Network: A convolutional neural network for robust face alignment, CVPRW 2017

The DAN-Menpo-tracking model is a single stage model with an additional layer that outputs the confidence of whether the tracking is correct.
This allows for detecting when loss of tracking occurs. This model is used in the following article:
HoloFace: Augmenting Human-to-Human Interactions on HoloLens, WACV 2018

Please note that all of the models are trained on the 300-W and Menpo datasets, which exclude commercial use.
You should contact s.zafeiriou@imperial.ac.uk to find out if it's OK for you to use the model files in a commercial product.

Thanks

Marek

thanks for your reply!

Hi friends,
I cannot train this DAN by theano using GPU on ubuntu 18.04, so please kindly let me know the pre-trained model which is trained by stage 1? (It's mean you trained it after feed forward network + S0, right?)
Thanks!

Hi,

Not sure I understand what you are asking for?
If you want to use only the first stage of the pretrained models you can initialize the model with nStages set to 1.

Thanks,

Marek

Hi Marek,
Thank you very much, but when I trained model with keras, I did not meet performance like you :(

Hi, one of the things that might help is early stopping of the first stage i.e. do not train the first stage till it overfits but stop training when the error stops updating frequently.

Hi Marek,
I did not make sense with your comment more, but when I used early stopping I got large error(that mean if loss in validation dataset not update frequently, I will stop it).I try the first stage like:

  • forward neural network in your document
  • after that I added the output of forward neural network with S0(initial landmark)
  • I using mse for loss function
    Do you have any suggestion for me?
    Thanks!

Hi,

Instead of mse you should use the error described in the paper, this actually makes quite a lot of difference!

Tell me if that improves your error as you expect.

Best regards,

Marek

Hi,
when I run ImageDemo.py always has some mistakes
eg:ValueError: mismatch: parameter has shape (256, 2) but value to set has shape (256, 3136)