add FP16 support to intel CPU
Ethan-Ming opened this issue · 1 comments
Ethan-Ming commented
/whisper-dictation/venv/lib/python3.8/site-packages/whisper/transcribe.py:114: UserWarning: FP16 is not supported on CPU; using FP32 instead
warnings.warn("FP16 is not supported on CPU; using FP32 instead")
it seems like fp16 is not supported on the intel CPU? Optimise the model to FP16 would be great
2nd option is to use a dedicated GPU, but most intel MAC uses AMD GPU so it might. be a extra step
foges commented
I don't think there's much that can be done about intel CPUs not supporting FP16. I should probably update the initialization to avoid the warnings. Thank you for raising the issue.