Add INT8-matrix performance - The current industry standard for measuring AI inference in TOPS
Opened this issue · 0 comments
NikosDi commented
Hello.
The definition of AI PC by Microsoft and others, the current industry standard for measuring AI inference in TOPS, is at INT8 precision.
I think it would be useful to add INT8-matrix performance metric to find out the TOPS.
TY