[Bug]Baichuan api call problem
Opened this issue · 1 comments
Search before asking
- I had searched in the issues and found no similar issues.
Operating system information
Linux
Python version information
=3.11
DB-GPT version
main
Related scenes
- Chat Data
- Chat Excel
- Chat DB
- Chat Knowledge
- Model Management
- Dashboard
- Plugins
Installation Information
-
AutoDL Image
-
Other
Device information
GPU—1 V100-32G
Models information
LLM:bc_proxyllm Embedding model:text2vec-large-chinese
What happened
2024-08-22 10:25:25 autodl-container-62da1183fa-c59ccf99 dbgpt.model.cluster.worker.default_worker[2274] ERROR Model inference error, detail: Traceback (most recent call last):
File "/root/DB-GPT/dbgpt/model/cluster/worker/default_worker.py", line 150, in generate_stream
) = self._prepare_generate_stream(
File "/root/DB-GPT/dbgpt/model/cluster/worker/default_worker.py", line 303, in _prepare_generate_stream
generate_stream_func = self.llm_adapter.get_generate_stream_function(
File "/root/DB-GPT/dbgpt/model/adapter/base.py", line 150, in get_generate_stream_function
raise NotImplementedError
NotImplementedError
What you expected to happen
在调用百川api回答知识库内容时出现上述问题
How to reproduce
1
Additional context
No response
Are you willing to submit PR?
- Yes I am willing to submit a PR!
This issue has been marked as stale
, because it has been over 30 days without any activity.