Implementation of Latent Normalisation
thorinf-orca opened this issue · 0 comments
thorinf-orca commented
In this line the normalisation is done by applying the reduce_mean
. Usually I would expect to see the sum, which would be L2 normalisation and would keep the vector at unit variance.
There is a normalisation strategy mentioned in the paper, however it does not match what has been implemented.
Would it be possible to get some clarification?
Thanks