Anil-matcha/ChatPDF

use LLM from huggingface

stl2015 opened this issue · 0 comments

stl2015 commented

Hi, I'm trying to use some LLM model from huggingface, for example "lmsys/vicuna-13b-v1.3". The model could be fetched through AutoModelForCausalLM.from_pretrained. However, what's the best way to wrap the model for integration with load_qa_chain?