eosphoros-ai/DB-GPT

[Bug]Baichuan api call problem

Opened this issue · 1 comments

Search before asking

  • I had searched in the issues and found no similar issues.

Operating system information

Linux

Python version information

=3.11

DB-GPT version

main

Related scenes

  • Chat Data
  • Chat Excel
  • Chat DB
  • Chat Knowledge
  • Model Management
  • Dashboard
  • Plugins

Installation Information

Device information

GPU—1 V100-32G

Models information

LLM:bc_proxyllm Embedding model:text2vec-large-chinese

What happened

2024-08-22 10:25:25 autodl-container-62da1183fa-c59ccf99 dbgpt.model.cluster.worker.default_worker[2274] ERROR Model inference error, detail: Traceback (most recent call last):
File "/root/DB-GPT/dbgpt/model/cluster/worker/default_worker.py", line 150, in generate_stream
) = self._prepare_generate_stream(
File "/root/DB-GPT/dbgpt/model/cluster/worker/default_worker.py", line 303, in _prepare_generate_stream
generate_stream_func = self.llm_adapter.get_generate_stream_function(
File "/root/DB-GPT/dbgpt/model/adapter/base.py", line 150, in get_generate_stream_function
raise NotImplementedError
NotImplementedError

What you expected to happen

在调用百川api回答知识库内容时出现上述问题

How to reproduce

1

Additional context

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

This issue has been marked as stale, because it has been over 30 days without any activity.