How to use the data train LLMs?

Question

How to use the data train LLMs?

lei1993 opened this issue a year ago · 1 comments

lei1993 commented a year ago

Answer 1 · 2023-08-27T09:07:50.000Z

I apologize for the delayed response. To utilize the data for training LLMs, you would need to design a custom prompt. In our case, we adopted a prompt structure similar to LangChain MRKL. We then perform standard instruction finetuning on Vicuna models and only optimize the loss on thought, action, and action input parts.