ModelTC/MQBench

关于混合精度mixed-precision量化的支持和bug问题

Closed this issue · 4 comments

Tlinn7 commented

你好最近在尝试使用MQbench的混合量化调试时，遇到几个问题想请教一下~

  1. 从脚本看，MQbench目前是支持混合精度的是吗？也就是通过hessian矩阵就算每层的量化敏感度信息，最后能通过计算得到每一层具体的量化比特数建议，对吗？有没有一些公开的信息去介绍？

非常感谢~

wimh966 commented

你好，是的，目前支持混合精度，能通过计算得到每一层具体的量化比特数建议。具体的算法信息可以参考论文HAWQ。

github-actions commented

This issue has not received any updates in 120 days. Please reply to this issue if this still unresolved!

Alicture commented

any update on this issue?

github-actions commented

This issue has not received any updates in 120 days. Please reply to this issue if this still unresolved!