microsoft/protein-sequence-models

Number of parameters for the CARP-24M don't add up

mhorlacher opened this issue · 0 comments

Hi,

When I apply the hyper parameters of the 24M model as specified in the table below, I obtain a model with only ~2M parameters. Thoughts?

image