fedirz/faster-whisper-server

AMD rocm GPU ?

nathan-skynet opened this issue · 2 comments

For use with ROCm and docker ? How to ?

I don't have an AMD GPU and I wouldn't be able to assist you here. Your best bet would be to take checkout https://github.com/SYSTRAN/faster-whisper and https://github.com/OpenNMT/CTranslate2. Please consider creating another issue if you end up figuring it out.

https://github.com/OpenNMT/CTranslate2 is not compatible with AMD GPUs despite all my attempts to get it to work as soon as a project runs with Ctranslate2 it is not compatible with AMD GPUs, I've also considered running projects with ZLUDA but it's the same result.