hkust-nlp/ceval

Issues

• Submit your results to C-Eval多久会有结果

  #88 opened 16 days ago by zellelin
  1

• C-Eval排行榜已经填写问卷，排行榜什么时候可以刷新

  #87 opened a month ago by Waneila
  1

• Failed to send verification code. Please try again.

  #78 opened 8 months ago by Wumengyao
  18

• 示例代码无法正常加载数据集

  #86 opened 3 months ago by ningmenghongcha
  1

• 发现几个问题好像标注答案不太对

  #84 opened 3 months ago by zky001
  1

• 上传模型评测结果到网页上报错 Any subject must contain at least 50 questions to be calculated

  #85 opened 3 months ago by mmarzl17
  1

• 为什么test数据集里没有正确答案的信息呢

  #83 opened 3 months ago by nanzhaogang
  1

• 您好，榜单什么时候更新，我们提交了三天了，能麻烦更新下吗

  #82 opened 4 months ago by Zheng-Jay
  1

• 申请公开榜单

  #81 opened 5 months ago by lingbaishun
  1

• C-Eval排行榜提交，排行榜什么时候可以刷新

  #80 opened 5 months ago by Waneila
  1

• 测试结果提交报错，点击process时，提示：Any subject must contain at least 50 questions to be calculated

  #79 opened 6 months ago by hailing2024
  1

• Leaderboard Update

  #77 opened 8 months ago by better-one
  1

• gpt-4-1106-preview 有人测试过 test 的分数吗？

  #68 opened a year ago by theblackcat102
  3

• The leaderboard in GitHub is out of sync with the latest version on the official website

  #76 opened 9 months ago by zhimin-z
  1

• Leaderboard Update

  #75 opened 10 months ago by 13416157913
  0

• HOW TO EVALUATE STEM???

  #74 opened a year ago by AkKari808
  1

• Leaderboard Update

  #72 opened a year ago by lijiahuan-01
  0

• C-Eval榜单从提交评测到榜单上能看到成绩大概需要多久？

  #70 opened a year ago by blueseasky
  0

• Fail to send verification code. Please try again

  #71 opened a year ago by Abigail61
  3

• Failed to send verification code. Please try again.

  #73 opened a year ago by Lukikay
  2

• 什么时候更新榜单呢？

  #69 opened a year ago by matrix-yang
  1

• Leaderboard Update

  #66 opened a year ago by chn91127
  0

• Leaderboard Update

  #67 opened a year ago by chn91127
  1

• public display

  #65 opened a year ago by jiahui098
  1

• 模型是否真正掌握了相关知识而不是在猜答案？

  #61 opened a year ago by yucc-leon
  3

• 请问chatglm3-6b-base发布在哪里？

  #64 opened a year ago by yayaQAQ
  1

• how to evaluate models trained by bloom serires base model?

  #48 opened a year ago by Modas-Li
  1

• prompt行尾含有空格会发生什么？为什么不能有空格

  #51 opened a year ago by cangyi071
  1

• 自然语言处理的相关任务属于知识型还是推理型任务呢？

  #59 opened a year ago by liumingzhu6060
  1

• llama和其他模型评测时不同点

  #63 opened a year ago by Chandler-Bing
  1

• 关于确认CEval可以被hack之后的计划

  #41 opened a year ago by yucc-leon
  3

• ##

  #62 opened a year ago by Kevin-KWH
  0

• 官方示例加载数据集报错

  #58 opened a year ago by JensenDong
  8

• 为什么我用c-eavl测试chatglm2-6B 在zero-shot 下的分数很低？

  #53 opened a year ago by EdisonWujr
  5

• Atom-13B不是公开访问的模型

  #60 opened a year ago by TerraceCN
  2

• 看不懂怎么用。。eval_llama.py是给基于llama的模型用的吗，有很多报错不知道怎么解决

  #49 opened a year ago by starevelyn
  3

• You guys posted a hilarious Leaderboatd on your official website

  #57 opened a year ago by stephonye
  1

• 测试集中的部分错误。

  #52 opened a year ago by hanjr92
  4

• 只能单选吗？可以多选吗？

  #56 opened a year ago by xxm1668
  1

• public display

  #54 opened a year ago by ZHangZHengEric
  2

• 申请公开

  #55 opened a year ago by huayicong23
  4

• C-Eval 提交规则限制

  #47 opened a year ago by suolyer
  3

• 请问模型公开结果需要做哪些动作呀？

  #50 opened a year ago by xyzhou-puck
  1

• chatglm2-6b在valid set上的zero-shot结果似乎有问题

  #46 opened a year ago by ylwangy
  4

• lm-evaluation-harness 是用test集测评的吗？

  #44 opened a year ago by ChangyuanWu
  1

• 官网无法登录，无法提交答案

  #45 opened a year ago by wuliaoren05
  0

• middle_school_history_test.csv 中有题目错误

  #40 opened a year ago by AiLMe-AI
  2

• Problematic question in test set

  #42 opened a year ago by wgb14
  1

• 提交结果问题

  #43 opened a year ago by 18811449050
  7

• 结果提交的疑问

  #39 opened a year ago by renmengjie7
  2