xjsong99/LipsNet

LipsNet-L implementation in K_Net Forward

ahanjaya opened this issue · 1 comments

https://github.com/jerry99s/LipsNet/blob/732b87c58947d5414009f9576e14d5b9c30119a9/lipsnet.py#L42

Hi, I'm trying to use LipsNet-L and found the implementation has slightly difference with the paper. In the paper, it's mentioned for the K network will have softplus activation. Could you please clarify if there's any mistake in this regard? Thanks.

Sorry for the late reply!

In the paper, the K network does have a softplus activation.
When you define the network, the parameter k_out_act should be set as nn.Softplus.
net = LipsNet(k_out_act=nn.Softplus, ...)

Now, in the 91 line in lipsnet.py, the default value of k_out_act has been changed from nn.Identity to nn.Softplus.
https://github.com/jerry99s/LipsNet/blob/8859ff2c84740fc1469e6f7f401586e73a058ab1/lipsnet.py#L90-L92