_pickle.UnpicklingError: invalid load key, 'v'.

[ahnHeejune]

(vicuna) ahnlab@ahnlab-desktop:~/GPT/StarCoder/GPTQ-for-SantaCoder$ python -m santacoder_inference bigcode/starcoderbase --wbits 4 --groupsize 128 --load starcoderbase-GPTQ-4bit-128g/model.pt
Loading checkpoint shards: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 7/7 [01:12<00:00, 10.29s/it]
Traceback (most recent call last):
File "", line 198, in _run_module_as_main
File "", line 88, in _run_code
File "/home/ahnlab/GPT/StarCoder/GPTQ-for-SantaCoder/santacoder_inference.py", line 90, in
main()
File "/home/ahnlab/GPT/StarCoder/GPTQ-for-SantaCoder/santacoder_inference.py", line 80, in main
model = get_santacoder(args.model, args.load, args.wbits, args.groupsize)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ahnlab/GPT/StarCoder/GPTQ-for-SantaCoder/santacoder_inference.py", line 40, in get_santacoder
model.load_state_dict(torch.load(checkpoint))
^^^^^^^^^^^^^^^^^^^^^^
File "/home/ahnlab/miniconda3/envs/vicuna/lib/python3.11/site-packages/torch/serialization.py", line 815, in load
return _legacy_load(opened_file, map_location, pickle_module, **pickle_load_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ahnlab/miniconda3/envs/vicuna/lib/python3.11/site-packages/torch/serialization.py", line 1033, in _legacy_load
magic_number = pickle_module.load(f, **pickle_load_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
_pickle.UnpicklingError: invalid load key, 'v'.

[YangYang-DLUT]

Is it solved? I met the same problem.