jeinlee1991/chinese-llm-benchmark

Issues

• deepseek-chat-v2.5 可以加入评测吗

  #53 opened 21 days ago by liyuefeng
  1

• 请问下打分是如何实现的？人工打分还是代码自动打分？

  #52 opened 19 days ago by dengfan2018
  1

• 评测数据太少了吧，这能说明问题？

  #14 opened a year ago by yyl424525
  2

• 希望评测100B以上开源模型：

  #51 opened a month ago by joey-zmw
  0

• 纯粹搞笑的评测, 收了百度多少钱?

  #43 opened 3 months ago by a5185330
  2

• 评测数据无法吐槽

  #35 opened 8 months ago by freedomRen
  5

• What is the evaluation criteria for the score?

  #19 opened a year ago by zhimin-z
  0

• 我们能不能增加一些基于智能体的评测

  #49 opened 2 months ago by CoderYiFei
  1

• 大模型原始输出结果

  #50 opened 2 months ago by KyleWang-Hunter
  1

• 请教下主观题是如何评测的？

  #46 opened 2 months ago by runwean
  1

• deepseek-chat-v2不是开源的吗

  #44 opened 2 months ago by liyuefeng
  1

• 可否测评下最新开源的qwen2.5?

  #45 opened 2 months ago by ConleyKong
  1

• Why does evaluation of encoding efficiency not count into the overall score?

  #17 opened a year ago by zhimin-z
  0

• Claude sonnet 3.5呢

  #48 opened 2 months ago by Skywalker144
  0

• 希望能够增加RWKV模型进行评测

  #6 opened a year ago by OopsYouDiedE
  4

• 可否评测一下stepfun的系列模型

  #42 opened 3 months ago by forrestlinfeng
  0

• 评测一下 deepseek v2

  #36 opened 4 months ago by cubxxw
  1

• 新增Yi-1.5系列模型的数据

  #38 opened 4 months ago by zzc0208
  1

• 可以增加llama3.1评测数据吗

  #41 opened 4 months ago by Anionex
  3

• 能不能对各能力做一个详细的解释啊？

  #40 opened 6 months ago by Wooden-Gear
  0

• 开个 Nemotron-4 340B 评价

  #39 opened 6 months ago by wrench1997
  0

• 10B以下的LLM排名不太准确，实际使用ChatGLM3-6B和Qwen1.5-7B表现更好

  #37 opened 7 months ago by danny-zhu
  2

• update new model

  #22 opened 7 months ago by zzc0208
  0

• 缺少重要的claude系列，申请加入相关测评

  #33 opened 8 months ago by chiguabaobao
  2

• 10b以下开源排名榜单不靠谱

  #34 opened 8 months ago by wyfSunflower
  0

• 建议增加1B模型测试

  #25 opened 8 months ago by yuys0602
  1

• 能否加入Function Call（工具调用）能力指标评测

  #31 opened 9 months ago by Dream-s-Wang
  1

• eval中是所有评测数据吗

  #3 opened 8 months ago by TTCoding
  1

• 通义千问的评测时间？

  #8 opened 8 months ago by liudayiheng
  0

• 很棒的测评，请问项目主测试数据可以转载吗

  #9 opened 8 months ago by l269438
  1

• 可以评测一下千问-7B模型吗

  #10 opened 8 months ago by liudayiheng
  0

• 强烈建议加入moonshot的Kimi chat！！！

  #16 opened 8 months ago by witherlll
  2

• 文心一言的新版本复测

  #20 opened 8 months ago by huanghuanhuahuh
  1

• 可以测试一下openbuddy-deepseek-67b-v15.2

  #21 opened 8 months ago by openmynet
  1

• 为什么千问1.5-14B-chat分这么高，比72b还高？

  #28 opened 8 months ago by yu-zheng-tao
  4

• 讯飞星火推出3.5版本

  #24 opened 8 months ago by zhisuyan
  1

• 可否将kimi chat加入榜单

  #26 opened 8 months ago by LengmoAngel
  1

• 能否加入qianwen1.5-32B的评测

  #32 opened 8 months ago by yu-zheng-tao
  2

• 讯飞星火13B开源模型测评

  #30 opened 9 months ago by STHSF
  0

• 可否增加claude3商用模型的评测

  #29 opened 9 months ago by yu-zheng-tao
  0

• 为什么千问1.5-14B-chat分这么高，比72b还高？

  #27 opened 9 months ago by yu-zheng-tao
  0

• Is there any arxiv paper or report for this benchmark?

  #23 opened a year ago by zhimin-z
  0

• This link does not redirect...

  #18 opened a year ago by zhimin-z
  0

• 我Claude呢？

  #15 opened a year ago by JiangKaslana
  0

• How should I cite this work?

  #13 opened a year ago by g-h-chen
  0

• 如果有各个模型的部署硬件要求对比就好了

  #12 opened a year ago by zhangmianhongni
  0

• 可以评测一下Chinese-LLaMA-Alpaca-2吗

  #11 opened a year ago by dodogreen
  0

• 很好的工作，不知道未来有将Anima-30B模型列入评测计划么？

  #7 opened a year ago by UI233
  0

• 如何提交自己的模型进行评测？

  #4 opened a year ago by Taoooo9
  1

• 提供结果复现代码

  #5 opened a year ago by azmat21
  0