IDEA-CCNL/Fengshenbang-LM

There is an error installing fengshen package.

Hubotcoder opened this issue · 0 comments

D:\svn\Fengshenbang-LM-main>pip3 install --editable .
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Obtaining file:///D:/svn/Fengshenbang-LM-main
  Preparing metadata (setup.py) ... done
Requirement already satisfied: transformers>=4.17.0 in c:\programdata\anaconda3\envs\chatglm\lib\site-packages (from fengshen==0.0.1) (4.30.2)
Collecting datasets>=2.0.0 (from fengshen==0.0.1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/09/7e/fd4d6441a541dba61d0acb3c1fd5df53214c2e9033854e837a99dd9e0793/datasets-2.14.5-py3-none-any.whl (519 kB)
Collecting pytorch_lightning>=1.5.10 (from fengshen==0.0.1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/98/09/9b2eab7833494e7c82f70c9b2f8e907d38231f4535704e3045a8a4960c8e/pytorch_lightning-2.1.0-py3-none-any.whl (774 kB)
Collecting deepspeed>=0.5.10 (from fengshen==0.0.1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (1.1 MB)
  Preparing metadata (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [13 lines of output]
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "C:\Users\Administrator\AppData\Local\Temp\pip-install-5yt2rnnb\deepspeed_8460634f010c4d6b9616524a6f71d5b0\setup.py", line 182, in <module>
          abort(f"Unable to pre-compile {op_name}")
        File "C:\Users\Administrator\AppData\Local\Temp\pip-install-5yt2rnnb\deepspeed_8460634f010c4d6b9616524a6f71d5b0\setup.py", line 52, in abort
          assert False, msg
      AssertionError: Unable to pre-compile async_io
      DS_BUILD_OPS=1
      �[93m [WARNING] �[0m async_io requires the dev libaio .so object and headers but these were not found.
      �[93m [WARNING] �[0m If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
      �[93m [WARNING] �[0m One can disable async_io with DS_BUILD_AIO=0
      �[31m [ERROR] �[0m Unable to pre-compile async_io
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

Hi, thank you for your work!
Is there anything I can do to move on?
Before this, I ran conda install cuda-compiler -c nvidia to address the CUDA_HOME does not exist issue.