num_tokens_from_messages() is not implemented
jinz2014 opened this issue · 0 comments
jinz2014 commented
Hello
I see the following message with the command below. Did I add the right commands to dt-run ? Thank you for the instructions.
dt-run +toxicity=realtoxicityprompts-toxic ++model=hf/lmsys/vicuna-13b-v1.1 ++dry_run=True ++toxicity.n=25 ++toxicity.template=1 ++conv_template="vicuna_v1.1"
0it [00:00, ?it/s]Warning: model not found. Using cl100k_base encoding.
0it [00:00, ?it/s]
num_tokens_from_messages() is not implemented for model lmsys/vicuna-13b-v1.1. See https://github.com/openai
/openai-python/blob/main/chatml.md for information on how messages are converted to tokens.