nihui/vkpeak

Add INT8-matrix performance - The current industry standard for measuring AI inference in TOPS

Opened this issue · 0 comments

Hello.

The definition of AI PC by Microsoft and others, the current industry standard for measuring AI inference in TOPS, is at INT8 precision.

I think it would be useful to add INT8-matrix performance metric to find out the TOPS.

TY