FudanSELab/ClassEval

Issues

• model—output

  #18 opened 2 months ago by lizhiOvO
  0

• Safety problem in Code

  #17 opened 3 months ago by 455849940
  1

• Lower test passing rates compared to original results.

  #7 opened 3 months ago by holen-zhang
  1

• Do you plan to update the benchmark?

  #8 opened 3 months ago by rodion-m
  1

• Pass@1 greedy results are changing whenever I re-evaluate

  #9 opened 3 months ago by sfc-gh-hhan
  1

• Does the Dataset Include These Topic Labels?

  #12 opened 3 months ago by ChoongTuckWai
  3

• ClassEval 5 improper assertion in tests

  #13 opened 3 months ago by doomspec
  0

• AccessGatewayFilter question

  #14 opened 3 months ago by xingjianll
  0

• Request: Standardize solution code and test filenames to class names.

  #16 opened 3 months ago by twitchy0
  0

• Benchmark Solution Code does not achieve 100%

  #15 opened 5 months ago by twitchy0
  0

• Wrong skeleton in ClassEval_17

  #10 opened 6 months ago by doomspec
  1

• ClassEval_2 wrong test case and function description

  #11 opened 6 months ago by doomspec
  1

• Question about the total number of methods in the benchmark

  #6 opened 8 months ago by ztwater
  3

• Where Can I Submit my Models for evaluation?

  #3 opened 9 months ago by ajinkya123-robo
  1

• How to run the unit tests test_pipeline.py?

  #4 opened 9 months ago by ramsey-coding
  1

• Evaluation script fails with error

  #5 opened 9 months ago by ramsey-coding
  3

• I'd like to test FIM capability of my model,does this test set have a fim subset?(i.e.function list depends on the following context)

  #1 opened a year ago by zndqs
  2

• Several minor issues when running tests on ClassEval.

  #2 opened a year ago by ztwater
  3