0cc4m/KoboldAI

AMD install out of date?

jthree2001 opened this issue · 6 comments

jthree2001 commented

I was running through the amd install instructions and the folder repos/gptq is missing and setup_cuda.py is also missing.

Are the AMD install instructions out of date?

0cc4m commented

Yes, they are. It was replaced with a Python wheel as well, but issues have been reported with it. I'll try to update them soon.

  • 👍1
keyxmakerx commented

+1 :)

celisum commented

+1

0cc4m commented

I updated them, please check if you can follow them and if it works.

  • 👍1
keyxmakerx commented

Got the following errors on the pip install

      Warning: The --amdgpu-target option has been deprecated and will be removed in the future.  Use --offload-arch instead.
      In file included from <built-in>:1:
      /opt/rocm-5.4.5/llvm/lib/clang/15.0.0/include/__clang_hip_runtime_wrapper.h:50:10: fatal error: 'cmath' file not found
      #include <cmath>
               ^~~~~~~
      1 error generated when compiling for gfx1030.

      RuntimeError: Error compiling objects for extension
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for gptq-koboldai
  Running setup.py clean for gptq-koboldai
Failed to build gptq-koboldai
ERROR: Could not build wheels for gptq-koboldai, which is required to install pyproject.toml-based projects
0cc4m commented

That means you are missing some system headers. Check your distro for the right package. It could be libstdc++-12-dev for Ubuntu, for example.

  • 👍1