replicate/replicate-python

How to pass chat histories?

failable opened this issue · 2 comments

For example, for model https://replicate.com/mistralai/mistral-7b-instruct-v0.1 , is the user required to format the whole chat histories into prompt param manually? Thanks.

Hi, @liebkne. Yes, you'll need to pass the previous chat history to the prompt input of the model. For long histories, you may need to perform summarization.

Ah, thanks.