TropComplique/trained-ternary-quantization

Are full precision weights normalized?

sangmain opened this issue · 0 comments

Are full precision weights normalized before quantization as in the original paper?

The original paper says:
"First, we normalize the full-precision weights to the range [-1, +1] by dividing each weight by the maximum weight."

And I cannot find any part in your code that normalizes the weights by dividing weights by the max values.
I would appreciate if you could give any help :D

Thank you in advance