Azure/MS-AMP

Question : does it work with Apple mps ?

Closed this issue · 2 comments

Question : does it work with Apple mps ?

wkcn commented

Hi @edmondja , thanks for your attention to our work!

MS-AMP does not support Apple MPS yet. The reason is that the FP8 data type (native or simulation), the type conversion between FP8 and high-precision data types such as FP16/BF16/FP32, as well as the FP8 optimizer are implemented using CUDA.

🥲thanks