How to pass chat histories?
failable opened this issue · 2 comments
failable commented
For example, for model https://replicate.com/mistralai/mistral-7b-instruct-v0.1 , is the user required to format the whole chat histories into prompt
param manually? Thanks.
mattt commented
Hi, @liebkne. Yes, you'll need to pass the previous chat history to the prompt
input of the model. For long histories, you may need to perform summarization.
failable commented
Ah, thanks.