hahnyuan/PTQ4ViT

Are the quantized models differentiable

SwapnilDreams100 opened this issue · 2 comments

SwapnilDreams100 commented

Hi,
Are the quantized models differentiable(i.e. can we get gradients using backprop using these) or is it not possible due to actual INT8 quantization? Pl reply ASAP

SuperVan-Young commented

The quantized models are not differentiable. We use round_() in pytorch to quantize, and it blocks gradients from backpropagation.

SwapnilDreams100 commented

Got it thanks