pointnetwork/point-alpaca

How can I chat with characters locally?

siriusctrl opened this issue · 3 comments

As listed in https://alpaca.point.space/ by hosting the model myself? For example, if I would like to create a character locally, should I further finetune the model with data from, say Genshin Impact, or I can do this through prompting?

On that website, we don't do any finetuning specifically for the characters. It's a simple prompting:

This is a conversation with a character: Alpaca
Description: Alpaca, an AI character with a cute and friendly personality, always eager to help
---
Alpaca: Hi there! I'm Point Alpaca, how can I help you?
You: <whatever the user says>
Alpaca:

temperature: 0.5
do_sample: True,
penalty_alpha: 0.4,
repetition_penalty: 1.2
top_k: 50
top_p: 1.0

On that website, we don't do any finetuning specifically for the characters. It's a simple prompting:

This is a conversation with a character: Alpaca
Description: Alpaca, an AI character with a cute and friendly personality, always eager to help
---
Alpaca: Hi there! I'm Point Alpaca, how can I help you?
You: <whatever the user says>
Alpaca:

temperature: 0.5 do_sample: True, penalty_alpha: 0.4, repetition_penalty: 1.2 top_k: 50 top_p: 1.0

Thanks for sharing, this is quite interesting as I feel like many of those characters know a lot of the world they lived in when I tried on the website. I personally write a short description about a Genshin character called Zhongli, but the text generated by the bot is not very coherent with his (real) background tho. Maybe I should include more information?

Similar question, if the background of a character is very long, how to create a good quality character?