RUCAIBox/LLMBox

Issues

• 同时测试多个子集的结果与单独测试每个子集的结果不同

  #275 opened 4 months ago by xansar
  3

• Error in Batch Sampler: IndexError: list index out of range

  #267 opened 5 months ago by krzz2q
  4

• 设置sample_num时，dataset的浅拷贝问题

  #270 opened 6 months ago by xansar
  1

• vllm_vllm_gpu_memory_utilization参数无效

  #271 opened 6 months ago by xansar
  1

• Support fine-tuning LLaMA3?

  #264 opened 6 months ago by cnlinxi
  4

• eval log格式问题

  #258 opened 7 months ago by xansar
  1

• Cannot load C-Eval from local directory

  #220 opened 7 months ago by xansar
  2

• ReadMe -error. "dataset/generation_dataset.py" file not found

  #249 opened 7 months ago by wangzaistone
  1

• Index out of bounds error when evaluating Mistral-7b-instruct-v0.2 on some instances of MMLU

  #217 opened 8 months ago by ShadowTinker
  2