Does MQBench supports Advanced PTQ on the transformer model?

Question

hobbitlzy opened this issue 2 years ago · 3 comments

The transformer model seems not to support layer-wisely finetuning on the calibration dataset. Will this feature be supported？

Answer 1 · 2022-11-21T07:32:28.000Z

Answer 2 · 2022-11-22T02:18:47.000Z

I'm sorry I didn't make it clear. Can the transformer model be finetuned using the AdaRound-like algorithm?

Answer 3 · 2023-03-22T02:21:21.000Z

This issue has not received any updates in 120 days. Please reply to this issue if this still unresolved!