ImportError: DLL load failed while importing exllamav2_ext: The specified procedure could not be found.
Opened this issue · 0 comments
Zueuk commented
With torch 2.1.2+cu121 and exllamav2 0.0.15+cu121.
The requirements.txt says that torch >= 2.1.0 is ok, but I was getting this error until I updated torch to the latest version.
An earlier version of exllamav2 did not work because of the Q4 thing that only the latest exllamav2 seems to have.