OptimalScale/LMFlow

Issues of local deployment

Yyyyyyxh opened this issue · 3 comments

您好。我尝试本地部署模型,
app.py中加入如下代码才能正常运行,
model args.model name or path = '/home/xfwl/huggingface/galactica-1.3b
部署完成后输入问题,机器人回答的是输入的内容,且有时还会回复代码。

http://lmflow.com 网页中微信群和discord链接全部都失效了,想进入社群学习。且这个网页的机器人不能对话。

下面是我下载的权重,引用,以及回复截图。
3271697620861_ pic
3281697620903_ pic
3261697620814_ pic

Thanks for your interest in LMFlow! Yeah this file has some hard-wired parameters, maybe @SHUMKASHUN can look into this issue and improve the interface? As for the QR code, we will update it soon, please wait for a while 😄

The QR code for wechat is updated accordingly in README.md (https://imgbb.com/ZhM4hhn), which is valid until Nov. 5. Thanks 😄