josStorer/RWKV-Runner
A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.
TypeScriptMIT
Pinned issues
Issues
- 1
lora微调训练问题
#347 opened by zigui123340 - 2
请教GPU负载均衡的问题
#346 opened by mystery3021 - 2
显卡能使用计算卡吗?
#343 opened by Xiao-yux - 2
因为ImportError: cannot import name 'packaging' from 'pkg_resources'导致模型转换失败
#345 opened by Builderbot2000 - 0
最新的rwkv-6-world模型转换后运行出错
#344 opened by CJJ-amateur-programmer - 3
服务启动成功,但是访问报500
#342 opened by lascyb - 0
install from source requirement.txt error on pkgutil
#341 opened by navr32 - 0
是否能够进行多batch的推理?
#338 opened by xinyinan9527 - 0
微调功能在上月新发布的 ubuntu 24.04 下失败
#337 opened by crabloveloli - 2
模型运行成功,但发的所有消息都显示network error,控制台显示报错。
#336 opened by LinWeiM - 1
JosStorer君,下载的东西都默认下载到C盘了。文件夹我是放到D盘的
#334 opened by WXH-qingmei - 0
希望重新生成之前的对话时不会自动滚动到最后一段聊天
#333 opened by Seikaijyu - 2
希望加入PISSA和LISA微调
#325 opened by Seikaijyu - 1
大佬,有兴趣加入Mirostat采样器吗?
#330 opened by shengxia - 1
如何完全卸载呢?
#331 opened by WarmRainIdea - 7
调用api接口感觉速度有点慢,是否和流式输出有关系,我看接口记录中流式输出参数是false,这个"stream": false, 参数在哪里可以设置呢?
#329 opened by zhuifengzl - 1
【新人求助】如果想写小说,有什么模型推荐?
#326 opened by lwstudy - 1
CPU/CPU(rwkv.cpp) 模型切换问题
#328 opened by BlindTriode - 4
Win10 無法啟動
#327 opened by AlliotQ - 6
我在本地配置了ollama,在聊天和续写时怎么调取?
#324 opened by liujvnes - 6
切换.bin模型失败
#322 opened by xwxYa - 1
MacOS版本的停止按钮失效?
#321 opened by Retromemory - 1
- 1
LoRa微调问题: 训练一段时间后 ,ubantu窗口和wsl窗口就关闭了
#319 opened by wanYuXuan - 2
希望能为系统角色修改前缀
#317 opened by Seikaijyu - 4
RWKV-Runner-v1.7.2懒人包-内置依赖和3B模型
#315 opened by a442509097 - 2
能不能加个深浅色模式自动跟随系统外观
#320 opened by Retromemory - 2
问个比较基础的问题,Runner中训练的上下文长度,具体影响什么?是模型回复的最大思考token数量还是用户输入的最大token数?又或者影响什么其他的东西?
#318 opened by Seikaijyu - 3
问个小白问题,这东东可以离线断网运行吗?
#316 opened by daonidedie - 10
UI Freezes When Focusing on Textbox on Linux
#314 opened by zicklag - 3
Network error when going to sleep or hibernate.
#313 opened by Kataphractoi - 1
Fail to connect to the model
#312 opened by geokfong - 3
Failed to enable custom CUDA kernel
#310 opened by Firepal - 1
CUDA和Pytorch已经安装,但依然提示Failed CUDA
#311 opened by kgolin - 1
Docker version missing: Configs, Models, Downloads and Train options on main screen
#309 opened by redshiva - 1
启动失败,提示 错误的PyTorch版本
#308 opened by kgolin - 2
启动失败,显示:切换模型失败 - Failed to fetch
#302 opened by miessbb - 2
请问这个框架支持continous-batching吗
#301 opened by 00ffcc - 11
400 bad request
#298 opened by Eliot00 - 0
希望能增加min-p
#300 opened by win10ogod - 4
希望能增加本地知识库功能
#299 opened by LX1309244704 - 1
v1.7.0在Windows Defender中报毒
#294 opened by FlexibleJerry - 1
某些模型在 AVOID_PENALTY 的 assert len(dd) == 1 这里会失败
#289 opened by zonde306 - 0
可以考虑增加 candle-rwkv 作为后端选择
#297 opened by nkypy - 1
启动模型报错:failed to load: MPS backend out of memory
#296 opened by rainbow57 - 1
expected scalar type Half but found Byte
#293 opened by cube3power - 3
v1.7.0 LoRa训练错误
#295 opened by Foahh - 1
macOS 14.2.1 没法下载模型,下载进度一直为 0
#292 opened by edwardmaxx - 3
Detected as a virus in sandboxes
#287 opened by sais-github - 1
能否增加一个 tokenizer 的 API
#288 opened by zonde306