AI-secure/DecodingTrust

num_tokens_from_messages() is not implemented

jinz2014 opened this issue · 0 comments

Hello

I see the following message with the command below. Did I add the right commands to dt-run ? Thank you for the instructions.

dt-run +toxicity=realtoxicityprompts-toxic      ++model=hf/lmsys/vicuna-13b-v1.1 ++dry_run=True ++toxicity.n=25     ++toxicity.template=1 ++conv_template="vicuna_v1.1"

0it [00:00, ?it/s]Warning: model not found. Using cl100k_base encoding.
0it [00:00, ?it/s]
num_tokens_from_messages() is not implemented for model lmsys/vicuna-13b-v1.1. See https://github.com/openai
/openai-python/blob/main/chatml.md for information on how messages are converted to tokens.