[Bug] run cpu get error

[citePerson]

Search before asking

• I had searched in the issues and found no similar issues.

Operating system information

Windows

Python version information

=3.11

DB-GPT version

main

Related scenes

• Chat Data
• Chat Excel
• Chat DB
• Chat Knowledge
• Model Management
• Dashboard
• Plugins

Installation Information

• Installation From Source

• Docker Installation

• Docker Compose Installation

• Cluster Installation

• AutoDL Image

• Other

Device information

on cpu

Models information

deploy on cpu

What happened

pip install python package and run project on cpu.but i get error " RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'" cpu not surport float16.please give me advice to solve this question.thank.
model: local chatglm-6b and semantic model:bge-m3

What you expected to happen

pip install python package and run project on cpu.but i get error " RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'" cpu not surport float16.please give me advice to solve this question.thank.
model: local chatglm-6b and semantic model:bge-m3

How to reproduce

pip install python package and run project on cpu.but i get error " RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'" cpu not surport float16.please give me advice to solve this question.thank.
model: local chatglm-6b and semantic model:bge-m3

Additional context

pip install python package and run project on cpu.but i get error " RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'" cpu not surport float16.please give me advice to solve this question.thank.
model: local chatglm-6b and semantic model:bge-m3

Are you willing to submit PR?

• Yes I am willing to submit a PR!