How to llama 2 conversion
yige0617 opened this issue · 1 comments
yige0617 commented
Do we have any instruction to llama 2 conversion from pytorch to tensorflow?
yige0617 commented
I cannot feed
model = AutoGPTQForCausalLM.from_quantized(quantized_model_dir, use_cuda_fp16=False,device="cuda:0")
directly into below function
keras_model = nobuco.pytorch_to_keras(
model,
......
)
what should be done here? Thanks!
What should I do to transform it into