PhoebusSi/Alpaca-CoT

多轮对话报错

lin1490188 opened this issue · 1 comments

NotImplementedError: return_offset_mapping is not available when using Python
tokenizers. To use this feature, change your tokenizer to one deriving from
transformers.PreTrainedTokenizerFast. More information on available tokenizers
at huggingface/transformers#2674

We will update this script later.