Have the plan to support fp8 inference?
lingzhi98 opened this issue · 9 comments
lingzhi98 commented
fp8 training is supported in keras. Does keras have plan to support fp8 inference? Maybe naive solution is enough like TransformerEngine.
fchollet commented
@james77777778 any thoughts on this?