AttributeError: 'OptLM' object has no attribute 'weight_home'

[shadowcz007]

AttributeError: 'OptLM' object has no attribute 'weight_home'

[yandod]

@shadowcz007 I am seeing same error. how did you resolve it?

[merrymercy]

Could you give the whole call stack?

[Regmas2]

[glenneroo]

I was able to help @Regmas2 resolve the issue by creating a new conda venv, followed by:

pip install torch==1.13.1+cu117 --extra-index-url https://download.pytorch.org/whl/cu117
pip install --upgrade Pillow
pip install -e .

Afterwards everything worked.

[yandod]

I resolved my issue with a reinstalling torch with cuda support same as above!

[pxc3113]

I checked out the index you provided but 1.13.1+cu117 is not in the list

(flexgen) C:\Users\35934>pip install torch==1.13.1+cu117 --extra-index-url https://download.pytorch.org/whl/cu117
Looking in indexes: https://pypi.org/simple, https://download.pytorch.org/whl/cu117
ERROR: Could not find a version that satisfies the requirement torch==1.13.1+cu117 (from versions: 2.0.0, 2.0.0+cu117, 2.0.1, 2.0.1+cu117)
ERROR: No matching distribution found for torch==1.13.1+cu117

[notice] A new release of pip available: 22.3.1 -> 23.1.2
[notice] To update, run: C:\Users\35934\AppData\Local\Microsoft\WindowsApps\PythonSoftwareFoundation.Python.3.11_qbz5n2kfra8p0\python.exe -m pip install --upgrade pip

[SeekPoint]

(gh_FlexGen) r730ub20@r730ub20-M0:/llm_dev/FlexGen$ pip install -e .
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Obtaining file:///home/r730ub20/llm_dev/FlexGen
Installing build dependencies ... done
Getting requirements to build wheel ... done
Installing backend dependencies ... done
Preparing wheel metadata ... error
ERROR: Command errored out with exit status 1:
command: /usr/bin/python3 /tmp/tmp06xly_hd prepare_metadata_for_build_wheel /tmp/tmpozbnb1uw
cwd: /home/r730ub20/llm_dev/FlexGen
Complete output (14 lines):
Traceback (most recent call last):
File "/tmp/tmp06xly_hd", line 280, in
main()
File "/tmp/tmp06xly_hd", line 263, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
File "/tmp/tmp06xly_hd", line 133, in prepare_metadata_for_build_wheel
return hook(metadata_directory, config_settings)
File "/tmp/pip-build-env-bruz6ip8/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 382, in prepare_metadata_for_build_wheel
self._bubble_up_info_directory(metadata_directory, ".egg-info")
File "/tmp/pip-build-env-bruz6ip8/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 353, in _bubble_up_info_directory
info_dir = self._find_info_directory(metadata_directory, suffix)
File "/tmp/pip-build-env-bruz6ip8/overlay/lib/python3.8/site-packages/setuptools/build_meta.py", line 364, in _find_info_directory
assert len(candidates) == 1, f"Multiple {suffix} directories found"
AssertionError: Multiple .egg-info directories found
----------------------------------------
ERROR: Command errored out with exit status 1: /usr/bin/python3 /tmp/tmp06xly_hd prepare_metadata_for_build_wheel /tmp/tmpozbnb1uw Check the logs for full command output.
(gh_FlexGen) r730ub20@r730ub20-M0:/llm_dev/FlexGen$

[SeekPoint]

pip install -e . always failed!!!

[Siddharthj2002]

Hey, I am still getting the same error. I have tried installing different Torch versions with CUDA, but I have been unlucky. Could someone please recommend some other solutions?