ClayShoaf/oobabooga-one-click-bandaid
A simple batch file to make the oobabooga one click installer compatible with llama 4bit models and able to run on cuda
Batchfile
Issues
- 1
install.bat doesn't exist
#4 opened by sgpascoe - 13
Doesn't work after latest pull
#2 opened by Slug-Cat - 5
SOLVED - wrong config files (llama 4bit:) RuntimeError: Error(s) in loading state_dict for LlamaForCausalLM: Missing key(s) in state_dict: "model.layers.32.self_attn.q_proj.zeros" ...
#1 opened by BarfingLemurs