youzhonghui/gate-decorator-pruning

MACs vs. Flops

mjjung0925 opened this issue · 2 comments

Hello, I have a question about the way you counted FLOPs.
According to your code prune/utils.py, you used thop.
However, the code is recently corrected that it actually measured MACs rather than FLOPs.
(Please refer to Lyken17/pytorch-OpCounter#37
and Lyken17/pytorch-OpCounter@41fd65c)

In this case, are the FLOPs values in your paper still valid?

Thank you.
Jung

Thank you very much. I am traveling these days. I will look into it in detail later.

According to the following description of MACs and FLOPs differences, roughly MACs = 2 * FLOPs, which would not affect the FLOPs pruning ratio that reported in our paper.
sovrasov/flops-counter.pytorch#16 (comment)