How can I chat with characters locally?
siriusctrl opened this issue · 3 comments
As listed in https://alpaca.point.space/ by hosting the model myself? For example, if I would like to create a character locally, should I further finetune the model with data from, say Genshin Impact, or I can do this through prompting?
On that website, we don't do any finetuning specifically for the characters. It's a simple prompting:
This is a conversation with a character: Alpaca
Description: Alpaca, an AI character with a cute and friendly personality, always eager to help
---
Alpaca: Hi there! I'm Point Alpaca, how can I help you?
You: <whatever the user says>
Alpaca:
temperature: 0.5
do_sample: True,
penalty_alpha: 0.4,
repetition_penalty: 1.2
top_k: 50
top_p: 1.0
On that website, we don't do any finetuning specifically for the characters. It's a simple prompting:
This is a conversation with a character: Alpaca Description: Alpaca, an AI character with a cute and friendly personality, always eager to help --- Alpaca: Hi there! I'm Point Alpaca, how can I help you? You: <whatever the user says> Alpaca:
temperature: 0.5 do_sample: True, penalty_alpha: 0.4, repetition_penalty: 1.2 top_k: 50 top_p: 1.0
Thanks for sharing, this is quite interesting as I feel like many of those characters know a lot of the world they lived in when I tried on the website. I personally write a short description about a Genshin character called Zhongli, but the text generated by the bot is not very coherent with his (real) background tho. Maybe I should include more information?
Similar question, if the background of a character is very long, how to create a good quality character?