Ai00-X/ai00_server

Issues

• Higher number of Num Tokens?

  #134 opened 2 months ago by hypnopump
  6

• ubuntu 24.04 load runtime failed: No such file or directory (os error 2)

  #143 opened 2 months ago by Alic-Li
  0

• discord channel?

  #38 opened 2 months ago by chymian
  0

• 模型的回答是空输出，偶尔能输出一次正常的；后面我将语言切换到中文后，最初对话顺序错乱后面就都正常；

  #39 opened 2 months ago by WenJieLife
  1

• Apple版本中，“设置/选择后端”为空不知该怎么办

  #135 opened 4 months ago by eyaeya
  1

• V0.5 前后端需求

  #120 opened 4 months ago by cryscan
  0

• v0.4 前后端需求汇总

  #68 opened 5 months ago by cgisky1980
  0

• Crash on chat: Cannot start a runtime from within a runtime.

  #108 opened 5 months ago by SinanAkkoyun
  3

• Server Startup Issue

  #110 opened 6 months ago by ItsCRC
  5

• 聊天过程中，输入问题后，希望加入回车发送问题

  #102 opened 6 months ago by abpyu
  2

• 使用ai00频繁爆语料

  #99 opened 6 months ago by Seikaijyu
  2

• 2 bugs in mirostat sampler

  #105 opened 6 months ago by cahya-wirawan
  3

• 用openai的API库发送请求，返回HTTP400

  #101 opened 6 months ago by saber28
  3

• Documents should not be deployed if not finished

  #96 opened 7 months ago by PJ-568
  3

• 怎么中断聊天

  #97 opened 6 months ago by BoFan-tunning
  1

• 怎么中断聊天

  #98 opened 6 months ago by BoFan-tunning
  0

• 0.3.24 outputs gibberish

  #93 opened 7 months ago by melang982
  5

• Feature request: Huggingface tokenizer support

  #94 opened 7 months ago by melang982
  1

• ambiguous finish reason

  #90 opened 7 months ago by josStorer
  0

• Issue starting server on Manjaro

  #89 opened 7 months ago by wereretot
  2

• 1.76环境ubuntu编译报错

  #75 opened 7 months ago by phpk
  2

• 小小的要求，能有主题更换功能吗？

  #61 opened 7 months ago by fireren999
  2

• v0.3 前后端需求汇总

  #40 opened 7 months ago by cryscan
  5

• [bug] Penalty decay argument seems to be compulsory?

  #67 opened 8 months ago by PicoCreator
  1

• Add min-p samping

  #63 opened 9 months ago by suhr
  1

• Feature request: NoRepeatNgram

  #64 opened 9 months ago by cahya-wirawan
  0

• server start problems

  #60 opened 10 months ago by chymian
  3

• Need help to run server in Kaggle

  #58 opened 10 months ago by tastypear
  2

• 是否存在基于CUDA的RWKV服务端？

  #43 opened a year ago by Pevernow
  2

• api使用问题

  #56 opened a year ago by yjs1224
  1

• 如何中断对话或续写?

  #53 opened a year ago by XieDeWu
  1

• convert_file() got multiple values for argument 'rename'

  #54 opened a year ago by nopepper
  1

• Fine-tune a converted safetensors model

  #52 opened a year ago by IgorAlexey
  1

• OpenAI api seems to not be working

  #47 opened a year ago by benbot
  6

• The generated text starts to be gibberish after around 1000 tokens

  #34 opened a year ago by cahya-wirawan
  7

• GPTQ quantification support.

  #24 opened a year ago by Pevernow
  1

• wgpu库进行计算着色器（Compute Shader）编译时出现了错误

  #25 opened a year ago by TralMac
  2

• Issue on ARM macos

  #49 opened a year ago by PicoCreator
  2

• 使用量化好的模型

  #29 opened a year ago by Pevernow
  2

• 切换模型

  #46 opened a year ago by wangrg
  1

• load a model to a explizit GPU

  #35 opened a year ago by chymian
  2

• error: slice 59522..59523 out of range for dimension size 50277 for Raven 7B

  #37 opened a year ago by chymian
  1

• API需求 state 、tps

  #31 opened a year ago by cgisky1980
  2

• 加快超长文本的state生成？

  #42 opened a year ago by Pevernow
  3

• fix sampler function

  #33 opened a year ago by cgisky1980
  0

• 硬件需求如何？

  #26 opened a year ago by xflcx1991
  0

• invalid Zip archive: Could not find central directory end',

  #32 opened a year ago by cahya-wirawan
  2

• Error: invalid Zip archive: Could not find central directory end

  #30 opened a year ago by ten2mushi
  5

• ubuntu 22.04.3 全新安装，intel核显，需要安装 vulkan-tools才能正常运行

  #27 opened a year ago by xflcx1991
  1

• 推理速度如何？

  #28 opened a year ago by Pevernow
  2