自加载的训练数据太长了，报错如何解决？ This model's maximum context length is 4097 tokens, however you requested 11552 tokens
rongweihe opened this issue · 1 comments
rongweihe commented
openai.error.InvalidRequestError: This model's maximum context length is 4097 tokens, however you requested 11552 tokens (3458 in your prompt; 8094 for the completion). Please reduce your prompt; or completion length.
loader = DirectoryLoader('/Users/geektime_chatgpt/llchain_input_data', glob='**/*.txt')
/Users/geektime_chatgpt/llchain_input_data 目录下加载一个训练数据，文本大小也就 4.7k 就报错了，请问有人知道如何解决么？🥹
liaokongVFX commented
参考这个：#19