Are full precision weights normalized?
sangmain opened this issue · 0 comments
sangmain commented
Are full precision weights normalized before quantization as in the original paper?
The original paper says:
"First, we normalize the full-precision weights to the range [-1, +1] by dividing each weight by the maximum weight."
And I cannot find any part in your code that normalizes the weights by dividing weights by the max values.
I would appreciate if you could give any help :D
Thank you in advance