josStorer/RWKV-Runner
A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.
TypeScriptMIT
Pinned issues
Issues
- 6
from numpy import BUFSIZE ImportError: cannot import name 'BUFSIZE' from 'numpy'
#353 opened by lwstudy - 0
显存占满之前就开始使用共享显存
#405 opened by 0pera - 0
切换模型时呼叫API:switch-model发生异常
#404 opened by tzengshinfu - 2
客户端运行模型,要求安装python依赖,安装报错
#402 opened by jonasqin - 1
Load state with API in server mode?
#401 opened by XDcsy - 4
win11下,软件自动闪退应该如何排错?
#396 opened by flandre520 - 0
- 0
Convert models to GGUF via llama.cpp
#400 opened by bennmann - 0
- 3
RWKV依赖错误
#351 opened by 2018436085 - 0
要進行sample訓練發生連線問題cuda-wsl-ubuntu.pin無法下載
#395 opened by SuPoTing - 3
请问如何搭载state
#391 opened by wudisong-hub - 1
能否增加文章扩写润色功能?
#394 opened by xlhawk - 0
启动模型时,CUDA_HOME已配置但报错
#393 opened by xqingting - 1
- 4
The MPS backend is supported on MacOS 12.3+.Current OS version can be queried using `sw_vers`
#388 opened by wudisong-hub - 0
如何运行Colossal-LLaMA-2-7b-base模型
#389 opened by Xiao-yux - 2
点训练,最后出现ModuleNotFoundError: No module named 'torch'
#385 opened by seed-da - 7
linux 模型运行失败
#386 opened by 0xHertz - 0
Use venv instead of running it directly
#387 opened by zrll12 - 1
macos14.6.1 M3 下首次运行新的模型pip报错,哪怕停用加速镜像也会有这样的错误
#384 opened by lvtao-net - 2
1.8.5 不能在windows7 X64的系统上运行
#377 opened by Fengsirgd - 0
webgpu版本有更新计划吗
#380 opened by dotffrt - 1
有什么办法既可以开启cuda自定义算子,又不会出现乱码
#371 opened by wuyougg - 0
服务器部署问题
#372 opened by panajanemo - 8
maxtoken设置的值较小时 回答的内容会被截断
#370 opened by LeopoldFize - 0
API调用问题
#369 opened by Zero-net-oss - 2
bin模型无法加载
#366 opened by yuelangjun - 0
请求添加新PIP源
#367 opened by pplokijuhyg - 0
- 5
bad CPU type in executable: ./backend-rust/web-rwkv-converter,macos 14.5 ,AMD Radeon Pro 5700 XT 16 GB,无法使用webgpu转化,请问是不支持吗?
#362 opened by mianayo - 8
- 1
开启CUDA算子后启动切换模型失败 - {"detail":"failed to load: list index out of range"} 切换模型失败 - {“详细信息:"无法加载:列表索引超出范围"}
#361 opened by lukiugi - 2
点击运行后显示没有模型
#358 opened by Order15 - 1
点击运行后显示没有模型
#359 opened by Order15 - 0
关于 load model
#357 opened by yyyoot - 0
是否聊天附件功能添加图片或者视频上传?
#356 opened by keeepman - 1
尝试了几个模型都无法启动,终端闪一下就没了,改端口没用
#355 opened by Buenbk - 0
前端界面功能不全,缺少部分按钮
#354 opened by Buenbk - 1
最新的rwkv-6-world模型转换后运行出错
#344 opened by CJJ-amateur-programmer - 1
Linux服务器的webGPU并行问题
#349 opened by shiroko98 - 0
ERROR: Could not find a version that satisfies the requirement torch==1.13.1 (from versions: none) ERROR: No matching distribution found for torch==1.13.1
#350 opened by 2018436085 - 0
linux部署的时候换一个rwkv模型无法运行
#348 opened by walekr12 - 1
lora微调训练问题
#347 opened by zigui123340 - 2
请教GPU负载均衡的问题
#346 opened by mystery3021 - 2
显卡能使用计算卡吗?
#343 opened by Xiao-yux - 2
因为ImportError: cannot import name 'packaging' from 'pkg_resources'导致模型转换失败
#345 opened by Builderbot2000 - 3
服务启动成功,但是访问报500
#342 opened by lascyb - 0
install from source requirement.txt error on pkgutil
#341 opened by navr32 - 0
是否能够进行多batch的推理?
#338 opened by xinyinan9527